Portable apparatus and method of changing screen of content thereof

ABSTRACT

A portable apparatus and a method of changing a content screen of the portable apparatus are provided. The portable apparatus includes changing a displayed content in response to an increase in a visual fatigue and a method of changing a content screen of the portable apparatus. Some of disclosed various embodiments provide a portable apparatus that calculates a visual fatigue by using user electroencephalogram (EEG) information received from a wearable apparatus and changing a displayed content into another content in response to an increase in the calculated visual fatigue, and a method of changing a content screen of the portable apparatus.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a continuation application of prior Application Ser.No. 16/166,834, filed on Oct. 22, 2018, which is a continuationapplication of prior Application Ser. No. 15/078,445, filed on Mar. 23,2016, which was based on and claimed priority under 35 U.S.C. § 119(a)of a Korean patent application filed on Apr. 30, 2015 in the KoreanIntellectual Property Office and assigned Serial No. 10-2015-0061725,the entire disclosure of which is hereby incorporated by reference.

TECHNICAL FIELD

The present disclosure relates to a portable apparatus and a method ofchanging a content screen thereof. More particularly, the presentdisclosure relates to a portable apparatus that changes a displayedcontent into another content in response to an increase in a visualfatigue of a user, and a method of changing a content screen thereof.

BACKGROUND

Various types of services and functions that are currently provided froma portable apparatus have been gradually expanded. Also, the portableapparatus provides a screen having a high resolution to a user.

As the user uses a screen having high luminance and high resolution fora long time, a visual fatigue of the user may increase. If the visualfatigue of the user is accumulated, a visual display terminal (VDT)syndrome may appear in the user. Also, eyesight of the user may bedeteriorated and/or eye disease of the user may occur due to theaccumulation of the visual fatigue of the user.

Therefore, there is a need for an apparatus and method of calculating avisual fatigue of a user and addressing an increase in the visualfatigue of the user.

The above information is presented as background information only toassist with an understanding of the present disclosure. No determinationhas been made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the present disclosure.

SUMMARY

Aspects of the present disclosure are to address at least theabove-mentioned problems and/or the disadvantages and to provide atleast the advantages described below. Accordingly, an aspect of thepresent disclosure is to provide a display apparatus and a method ofchanging a content screen of a portable apparatus that includesdisplaying content, receiving bio-information of the user from awearable apparatus, calculating a visual fatigue based on thebio-information of the user, and displaying other content in response toan increase in the visual fatigue.

In accordance with an aspect of the present disclosure, a portableapparatus is provided. The portable apparatus includes a display unitconfigured to display content, a communicator configured to be connectedto a wearable apparatus, and a controller configured calculate a visualfatigue by using bio-information of the user received from the wearableapparatus through the communicator and display other content in responseto an increase in the visual fatigue.

In accordance with another aspect of the present disclosure, a wearableapparatus is provided. The wearable apparatus includes a sensor locatedin a body of the wearable apparatus and include a measurement electrodeand a reference electrode contacting a body of a user, a communicatorconfigured to be connected to a portable apparatus, and a controllerconfigured to detect an electroencephalogram (EEG) of the user using thesensor and transmit EEG information of the user corresponding to the EEGto the portable apparatus through the communicator, wherein the body ofthe wearable apparatus may have one of a circular shape, an ellipticalshape, and a polygonal shape.

A portable apparatus for changing a displayed content into anothercontent in response to an increase in a visual fatigue of a user and amethod of changing a content screen of the portable apparatus may beprovided.

A portable apparatus for changing a displayed content into anothercontent to relax a visual fatigue in response to an increase in thevisual fatigue and a method of changing a content screen of the portableapparatus may be provided.

A portable apparatus for changing a displayed content into various typesof contents relaxing a visual fatigue in response to an increase in thevisual fatigue and a method of changing a content screen of the portableapparatus may be provided.

A portable apparatus for calculating a visual fatigue of a user by usingEEG data of the user and a method of changing a content screen of theportable apparatus may be provided.

A portable apparatus for changing a displayed content into anothercontent in response to an increase in a visual fatigue calculated byusing EEG information of a user received from a wearable apparatus and amethod of changing a content screen of the portable apparatus may beprovided.

A portable apparatus for changing a displayed content into anothercontent including an ocular movement guide in response to an increase ina visual fatigue calculated by using EEG information of the userreceived from a wearable apparatus and detecting whether an ocularmovement of the user is performed, by using a camera and a method ofchanging a content screen of the portable apparatus may be provided.

In accordance with another aspect of the present disclosure, a portableapparatus that may calculate a visual fatigue by using brainwaveinformation received from an external source, and a method of changing acontent screen thereof may be provided.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the present disclosure will be more apparent from thefollowing description taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 schematically illustrates a connection between a portableapparatus, a wearable apparatus, and a server according to an embodimentof the present disclosure;

FIG. 2 is a schematic block diagram of a portable apparatus, a wearableapparatus, and a server according to an embodiment of the presentdisclosure;

FIGS. 3A and 3B are schematic perspective views of a wearable apparatusaccording to an embodiment of the present disclosure;

FIG. 4 is a schematic flowchart of a method of changing a content screenof a portable apparatus according to an embodiment of the presentdisclosure;

FIGS. 5A to 5F, 6A to 6D, 7A to 7C, 8A and 8B, 9A to 9C, 10A and 10B,and 11A and 11B illustrate a content screen of a portable apparatusaccording to various embodiments of the present disclosure; and

FIG. 12A to 12C illustrate an environment setting screen of a portableapparatus according to various embodiments of the present disclosure.

Throughout the drawings, it should be noted that like reference numbersare used to depict the same or similar elements, features, andstructures.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments of the present disclosure as defined by the claims and theirequivalents. It includes various specific details to assist in thatunderstanding but these are to be regarded as merely exemplary.Accordingly, those of ordinary skill in the art will recognize thatvarious changes and modifications of the various embodiments describedherein can be made without departing from the scope and spirit of thepresent disclosure. In addition, descriptions of well-known functionsand constructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of the presentdisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of various embodiments of the presentdisclosure is provided for illustration purpose only and not for thepurpose of limiting the present disclosure as defined by the appendedclaims and their equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

In the following description, the same drawing reference numerals areused for the same elements even in different drawings. The mattersdefined in the description, such as detailed construction and elements,are provided to assist in a comprehensive understanding of the presentdisclosure. Thus, it is apparent that the various embodiments of thepresent disclosure can be carried out without those specifically definedmatters. Also, well-known functions or constructions are not describedin detail since they would obscure the disclosure with unnecessarydetail.

Also, the terms “first”, “second”, etc. may be used to describe diversecomponents, but the components are not limited by the terms. The termsare only used to distinguish one component from the others. For example,a first element may be referred to as a second element, and the secondelement may also be referred to as the first element without departingfrom the scope of the present disclosure. As used herein, the term“and/or” includes any and all combinations of one or more of theassociated listed items.

An application refers to application software that is executed in acomputer operating system (OS) or a mobile OS to provide services (orinformation) to a user. For example, the application may include a wordprocessor, a spread shift, a contacts application, a calendarapplication, a memo application, an alarm application, a social networksystem (SNS) application, a chatting application, a map application, amusic player, a visual fatigue management application, or a videoplayer. The application according to various embodiments of the presentdisclosure may refer to a visual fatigue management application that isexecuted in a portable apparatus or a visual fatigue managementapplication that is executed in a wearable apparatus (e.g., a brainwavemeasurement wearable apparatus or the like) that is connected to theportable apparatus by wireless or wired. The application according tothe various embodiments of the present disclosure may also refer tosoftware that is executed in a portable apparatus in response to areceived user input (e.g., a touch or the like).

According to various embodiments of the present disclosure, a status ofa wearable apparatus may refer to a context of the wearable apparatus.Status information corresponding to the status of the wearable apparatusmay refer to context information of the wearable apparatus. A statuschange of the wearable apparatus may be the same as a context change ofthe wearable apparatus.

A widget refers to a mini application that is one of graphic userinterfaces (GUIs) that further smoothly support an interaction between auser and an application or an OS. For example, there may be a weatherwidget, a calculator widget, a watch widget, etc.

A content may be displayed in an application that is executed in aportable apparatus or a wearable apparatus. For example, the content mayinclude a video file or an audio file played in a video player that isone of applications, a music file played in a music player, a photo filedisplayed in a photo gallery, a webpage file displayed in a web browser,etc. The content may also include a video file, an audio file, a textfile, an image file, or a webpage that is displayed or executed in anapplication. The term “video” used in the various embodiments of thepresent disclosure may be used as the same meaning as a moving image.Also, the content may include a video file, an audio file, a text file,an image file, or a webpage that is executed in response to a receiveduser input (e.g., a touch or the like).

The content may include an application screen executed in a wearableapparatus and a user interface (UI) configuring the application screen.The content may also include one content or a plurality of contents.

In various embodiments of the present disclosure, a display may includea screen of a touch screen or a screen of a display unit that displays acontent.

In various embodiments of the present disclosure, bio-information of auser may include brainwaves, a temperature, pulses, a heartbeat, pulserate variations, a blood pressure, blood glucose, breath information,oxygen saturation, a skin status, stress, a stress index, sleepinformation, etc. of a user.

In various embodiments of the present disclosure, a wearable apparatusmay refer to a bio-information detecting apparatus that detectsbio-information of a user. The bio-information detecting apparatus maybe realized as a watch, glasses, a ring, a bracelet, a necklace, aheadband, or the like.

In various embodiments of the present disclosure, a change of anothercontent may include a font size of a content displayed in a displayedapplication, an addition of a color screen to the content, a display ofan ocular movement guide in the content, or a display of an ocularmovement animation in the content.

A visual fatigue may occur to a user who concentrates on a contentdisplayed in a portable apparatus or views a content for a long time.Surrounding environment elements (e.g., ambient light, temperature,humidity, etc.) causing the visual fatigue and user bio-elements (e.g.,corresponding to bio-information such as a body temperature, aheartbeat, etc.) may be diverse. Elements causing the visual fatigue mayinclude dazzle, humidity, bloodshot eyes, dimness of letters, dizziness,lethargy and/or insensibility of eyes, or a physical abnormality degreeof eyes. Also, the elements causing the visual fatigue may include afatigue of a part such as a neck or the like, fatigue of an arm and/or awrist and/or a shoulder, a fatigue of a leg part, or headache. Inaddition, elements causing the visual fatigue may include a brightnessdegree of ambient light or a surrounding noise degree.

In the present application, the terms “include” and “comprise” designatethe presence of features, numbers, operations, components, elements, ora combination thereof that are written in the specification, but do notexclude the presence or possibility of addition of one or more otherfeatures, numbers, operations, components, elements, or a combinationthereof. The like reference numerals in the drawings denote elementsthat perform the same functions.

FIG. 1 schematically illustrates a connection between a portableapparatus, a wearable apparatus, and a server, according to anembodiment of the present disclosure.

Referring to FIG. 1, the portable apparatus 100, the wearable apparatus200, and the server 300 may be wirelessly connected to one another byrespectively using communicators (refer to FIG. 2) of the portableapparatus 200, the wearable apparatus 200, and the server 300. Forexample, the portable apparatus 100, the wearable apparatus 200, and theserver 300 may be connected to one another in an infra-structure modewhere the portable apparatus 100, the wearable apparatus 200, and theserver 300 are wirelessly connected to one another through an ad-hocmode or an access point (AP). The portable apparatus 100 and thewearable apparatus 200 may respectively transmit a content received fromthe server 300 to each other.

The server 300 may be located around the portable apparatus 100 and thewearable apparatus 200 or may be located remotely from the portableapparatus 100 and the wearable apparatus 200 (e.g., in a cloud server orthe like).

For example, a wireless communication may be a wireless local areanetwork (LAN), Wi-Fi, Bluetooth low energy, Zigbee, Wi-Fi direct (WFD),ultra-wideband (UWB), infrared data association (IrDA), near fieldcommunication (NFC), or the like but is not limited thereto. Also, theportable apparatus 100, an electronic apparatus, the server 300, and thewearable apparatus 200 may be connected to one another by wire through aconnector.

The portable apparatus 100 may receive status change informationcorresponding to a status change (e.g., turning on and/or off, abrainwave detection, or the like) of the wearable apparatus 200 from thewearable apparatus 200 through an application. The portable apparatus100 may also receive the status change information corresponding to thestatus change (e.g., turning on and/or off, the brainwave detection, orthe like) of the wearable apparatus 200 through the server 300. Theportable apparatus may include a front surface 100 a and a back surface(not shown). Also, the portable apparatus 100 may include a home screen191, which may include an icon menu screen 193 that includes, amongothers, a shortcut icon 193 g.

The portable apparatus 100 may change a status of the wearable apparatus200 (e.g., may request turning on, a brainwave detection, or the like ofthe wearable apparatus 200) through one of the application and theserver 300.

The portable apparatus 100, the wearable apparatus 200, and the server300 have been described as being directly connected to one another withreference to FIG. 1. However, the portable apparatus 100, the wearableapparatus 200, and the server 300 may be connected to one anotherthrough a sharer, a router, a wireless internet network, or the like.

FIG. 2 is a schematic block diagram of a portable apparatus, a wearableapparatus, and a server according to an embodiment of the presentdisclosure.

Referring to FIG. 2, the portable apparatus 100 may be connected toanother apparatus (e.g., the wearable apparatus 200 or the server 300)by wire or wirelessly by using a mobile communicator 120, a subcommunicator 130, and a connector 165.

The portable apparatus 100 according to an embodiment may refer to anapparatus that may calculate a visual fatigue of a user by usingbio-information and an application including user electroencephalogram(EEG) received from the wearable apparatus 200 and/or an apparatus thatmay infer the visual fatigue of the user by using an application withoutthe bio-information of the user (e.g., EEG) received from the wearableapparatus 200.

The portable apparatus 100 may refer to an apparatus that may change acontent displayed on a touch screen or a display unit in response to thecalculated visual fatigue. For example, the portable apparatus 100 mayinclude a portable phone, a smartphone, a tablet apparatus, ahead-mounted display apparatus having a display unit, a Motion PictureExperts Group (MPEG-1 or MPEG-2) Audio Layer 3 (MP3) player, a movingimage player, an electronic bulletin board, a monitor, an electronicapparatus (e.g., a refrigerator, a washer, an air conditioner, or thelike) having a display unit, a display apparatus, or the like. Thehead-mounted display apparatus (not shown) that is one of portableapparatuses 100 may include a sensor (e.g., an electrode) that maydetect user EEG. If the visual fatigue detected through the sensorincreases, the head-mounted display apparatus including the sensorcapable of detecting the user EEG may change a content displayed on adisplay unit (not shown) into another content capable of reducing thevisual fatigue.

It will be easily understood by those skilled in the art that thedisplay apparatus may be realized as an analog television (TV), adigital TV, a 3-dimensional (3D) TV, a smart TV, a light emitting diode(LED) TV, an organic LED (OLED) TV, a plasma TV, a curved TV having afixed curvature screen, a flexible TV having a fixed curvature screen, abended TV having a fixed curvature screen, and/or a curvature variableTV capable of changing a curvature of a screen through a user input butis not limited thereto.

The portable apparatus 100 may include a touch screen 190 to transmitdata (or a content) to an external source through the mobilecommunicator 120 or the sub communicator 130 or receive the data (or thecontent) from the external source through the mobile communicator 120 orthe sub communicator 130. The portable apparatus 100 may include aninput pen 167 and the touch screen 190 to transmit the data (or thecontent) to the external source through the mobile communicator 120 orthe sub communicator 130 or receive the data (or the content) from theexternal source through the mobile communicator 120 or the subcommunicator 130. The portable apparatus 100 may transmit the data tothe external source or receive the data from the external source inresponse to an interaction (e.g., a touch or a touch gesture) input onthe touch screen 190. The portable apparatus 100 may also include adisplay unit (not shown) having only a display panel (e.g., having notouch panel) to transmit the data (or the content) to the externalsource or receive the data (or the content) from the external sourcethrough the mobile communicator 120 or the sub communicator 130.

The portable apparatus 100 may include a controller 110, the mobilecommunicator 120, the sub communicator 130, a multimedia unit 140, acamera 150, a global positioning system (GPS) 155, an input/output (I/O)unit 160, a sensor unit 170, a storage unit 175, and a power supply unit180. The portable apparatus 100 also includes the touch screen 190 and atouch screen controller 195.

The controller 110 may include a processor 111, a read only memory (ROM)112 that stores a control program for controlling the portable apparatus100, and a random access memory (RAM) 113 that stores a signal or datainput from an outside of the portable apparatus 100 or that is used as astorage area for various types of jobs performed in the portableapparatus 100.

The controller 110 controls an overall operation of the portableapparatus 100 and a signal flow between internal elements 120 through195 of the portable apparatus 100 and performs a function of processingthe data. The controller 110 controls power supplied to the internalelements 120 through 195 by using the power supply unit 180. If an inputof the user is received or a set condition is satisfied, the controller110 may operate a sensor of the sensor unit 170 or may execute an OS oran application stored in the storage unit 175.

The processor 111 may include a graphic processing unit (GPU) (notshown) for graphic processing. The processor 111 may be realized as asystem on chip (SoC) including a core (not shown) and a GPU (not shown).The processor 111 may include a single core, a dual core, a triple core,a quad core, and a multiple core. Also, the processor 111, the ROM 112,and the RAM 113 may be connected to one another through a bus.

The controller 110 may control the mobile communicator 120, the subcommunicator 130, the multimedia unit 140, the camera 150, the GPS 155,the I/O unit 160, the sensor unit 170, the storage unit 175, the powersupply unit 180, the touch screen 190, and the touch screen controller195.

The controller 110 according to an embodiment displays the content on ascreen, is connected to the wearable apparatus 200 through acommunicator, calculates a visual fatigue by using EEG information ofthe user received from the wearable apparatus 200 through thecommunicator, and changes the content into another content in responseto an increase in the visual fatigue.

The controller 110 may display a content, receive EEG information of theuser from the wearable apparatus 200, calculate a visual fatigue basedon the EEG information of the user, and change the content into anothercontent in response to an increase in the visual fatigue.

The controller 110 may control to request the wearable apparatus 200 todetect EEG through the communicator.

If the other content is a content including an ocular movement guide,the controller 110 may control the other content including the ocularmovement guide to execute the camera 150 in response to an executionaccording to an increase in the visual fatigue.

The controller 110 may control to display different color screens inresponse to a second application displaying the content.

The controller 110 may control to change the other content in responseto the second application displaying the content.

The controller 110 may control to display a pop-up window correspondingto the increase in the visual fatigue.

The controller 110 may control to provide a feedback corresponding tothe increase in the visual fatigue.

The term “controller” used herein includes the processor 111, the ROM112, and the RAM 113.

The mobile communicator 120 may be connected to another apparatus (e.g.,the wearable apparatus 200 or the server 300) through a mobilecommunication network by using one antenna or two or more antennas undercontrol of the controller 110. The mobile communicator 120 may receiveEEG data from the wearable apparatus 200 under control of the controller110. The received EEG data (e.g., analog data or digital data) may bestored in the storage unit 175 under control of the controller 110.

The mobile communicator 120 may transmit and/or receive a wirelesssignal for a voice call, video call, a text message (e.g., a shortmessage service (SMS)), a multimedia message (e.g., a multimediamessaging service (MMS)), and data communication with a portable phone(not shown), a smartphone (not shown), a tablet personal computer (PC),or another portable apparatus (not shown) having a connectable phonenumber.

The sub communicator 130 may be connected to another apparatus (e.g.,the wearable apparatus 200 or the server 300) through a wireless LAN 131and a short-range communicator 132 under control of the controller 110.The sub communicator 130 may include at least one selected from thewireless LAN 131 and the short-range communicator 132 (e.g., one or bothof the wireless LAN 131 and the short-range communicator 132).

The sub communicator 130 may receive the EEG data from the wearableapparatus 200 under control of the controller 110. The received EEG data(e.g., analog data or digital data) may be stored in the storage unit175 under control of the controller 110.

The wireless LAN 131 may be wirelessly connected to an AP in a place,where the AP is installed, under control of the controller 110. Thewireless LAN 131 may, for example, include Wi-Fi. The wireless LAN 131supports wireless LAN standard IEEE 802.11x of IEEE. The short-rangecommunicator 132 may perform a short-range communication between theportable apparatus 100 and an external apparatus by wireless without theAP under control of the controller 110. The short-range communicationmay include Bluetooth, Bluetooth low energy, IrDA, UWB, NFC, etc.

The portable apparatus 100 may include at least one selected from themobile communicator 120, the wireless LAN 131, and the short-rangecommunicator 132 according to a performance thereof. For example, theportable apparatus 100 may include one of the mobile communicator 120,the wireless LAN 131, and the short-range communicator 132 or acombination of the mobile communicator 120, the wireless LAN 131, andthe short-range communicator 132. The portable apparatus 100 may beconnected to various types of external accessories (e.g., a wirelessspeaker, a wireless headset, etc.) by using one of the mobilecommunicator 120 and the sub communicator 130.

The term “communicator” used herein includes the mobile communicator 120and the sub communicator 130.

The multimedia unit 140 may receive an external broadcast and play audioand/or a moving image under control of the controller 110. Themultimedia unit 140 may include a broadcast receiver 141, an audioplayer 142, and a moving image player 143.

The broadcast receiver 141 may receive a broadcast signal and additionalbroadcast information (e.g., an electronic program guide (EPG) or anelectronic service guide (ESG)) from an external broadcasting stationthrough an antenna (not shown) under control of the controller 110.Also, the controller 110 may control to play the received broadcastsignal and additional broadcast information by using a touch screen, avideo codec (not shown), and an audio codec (not shown).

The audio player 142 may play an audio source (e.g., an audio fileincluding file extension mp3, ogg, or way) pre-stored in the storageunit 175 of the portable apparatus 100 or received from an externalsource by using the audio codec under control of the controller 110.

According to an embodiment of the present disclosure, the audio player142 may play an auditory feedback corresponding to a content changed inresponse to an increase in a visual fatigue. For example, the audioplayer 142 may receive EEG information from the wearable apparatus 200and analyze the received EEG information to play an auditory feedback(e.g., an output of an audio source stored in a storage unit or thelike) corresponding to a content changed in response to an increase in avisual fatigue through an audio codec under control of the controller110.

According to an embodiment of the present disclosure, the audio player142 may play an auditory feedback (e.g., an output of an audio sourcestored in a storage unit or the like) corresponding to a touch detectedon the touch screen 190 or consecutive motions of the touch through anaudio codec under control of the controller 110.

The moving image player 143 may play a digital moving image source(e.g., a video file including file extension mpeg, mpg, mp4, avi, mov,or mkv), which is pre-stored in the storage unit 175 of the portableapparatus 100 or received from an external source, by using a videocodec under control of the controller 110. A multimedia application thatmay be installed in the portable apparatus 100 may play an audio sourceor a moving image source by using an audio codec and/or a video codec.The multimedia application that may be installed in the portableapparatus 100 may also play a moving source image by using a hardwarecodec (not shown) and/or a software codec (not shown).

According to an embodiment of the present disclosure, the moving imageplayer 143 may play a visual feedback corresponding to a content changedin response to an increase in a visual fatigue. For example, the movingimage player 143 may receive EEG information from the wearable apparatus200 and analyze the received EEG information to play a visual feedback(e.g., an output of a moving image source stored in a storage unit orthe like) corresponding to a content changed in response to an increasein a visual fatigue through a video codec under control of thecontroller 110.

It will be easily understood by those skilled in the art that varioustypes of video codecs and audio codecs capable of playing audio and/orvideo files having various types of file extensions have been producedand sold.

The multimedia unit 140 may include the audio player 142 and the movingimage player 143 except the broadcast receiver 141 in response to aperformance or a structure of the portable apparatus 100. Also, thecontroller 110 may be realized to include the audio player 142 or themoving image player 143 of the multimedia unit 140.

The term “audio codec” used herein may include one audio codec or two ormore audio codecs. The term “video codec” used herein may include onevideo codec or two or more video codecs.

The camera 150 may capture a still image or a moving image under controlof the controller 110. The camera 150 may include at least one selectedfrom a first camera 151 provided in a front surface (e.g., 100 a ofFIG. 1) of the portable apparatus 100 and a second camera 152 providedin a back surface (not shown) of the portable apparatus 100. Forexample, the camera 150 may include one or both of the first camera 151and the second camera 152. Also, the first camera 151 or the secondcamera 152 may include a sub light source (e.g., a flash 153) thatprovides an amount of light necessary for capturing.

The camera 150 may be realized to further include the first camera 151provided in the front surface and an additional camera (e.g., a thirdcamera (not shown)) adjacent to the first camera 151. For example, adistance between the third camera and the first camera 151 may berealized to be longer than 30 mm and shorter than 80 mm. If the camera150 further includes the third camera, the controller 110 may capture a3D still image or a 3D moving image by using the first camera 151 andthe third camera.

The camera 150 may be realized to further include the second camera 152provided in the back surface and an additional camera (e.g., a fourthcamera (not shown)) adjacent to the second camera 152. For example, adistance between the fourth camera and the second camera 152 may berealized to be longer than 30 mm and shorter than 80 mm. If the camera150 further includes the fourth camera, the controller 110 may capture a3D still image or a 3D moving image by using the second camera 152 andthe fourth camera. Also, the cameras 151 and 152 may perform wide-anglecapturing, telephoto capturing, and close-up capturing by using anadditional lens (not shown) that is removable from an additional adaptor(not shown).

The GPS 155 periodically receives signals (e.g., orbit information, timeinformation, navigation messages, etc. of GPS satellites) from aplurality of GPS satellites that exist on earth's orbit. In an outdoorplace, the portable apparatus 100 may calculate locations of theplurality of GPS satellites and a location of the portable apparatus 100by using signals received from the plurality of GPS satellites andcalculate distances between the plurality of GPS satellites and theportable apparatus 100 by using transmission and/or reception timedifferences. A location, a time, or a movement speed of the portableapparatus 100 may be calculated through a triangulation. An additionalGPS satellite may be required for an orbit correction or a timecorrection. Even indoors, where signals are received from the pluralityof GPS satellites through the GPS 155, the portable apparatus 100 maycalculate a location, a time, or a movement speed of the portableapparatus 100.

In the outdoor place, the portable apparatus 100 may detect a locationor a movement speed by using a wireless AP (not shown). The detection ofthe location of the portable apparatus 100 may be performed by using acell-identification (ID) method using an ID of the wireless AP, anenhanced cell-ID method using the ID and a received signal strength(RSS) of the wireless AP, or an angle of arrival (AoA) method using anangle of a signal transmitted from an AP to the portable apparatus 100.

The portable apparatus 100 may also detect the location or the movementspeed of the portable apparatus 100 located indoors by using a wirelessbeacon (not shown). It will be easily understood by those skilled in theart that an indoor location of the portable apparatus 100 may bedetected through various types of methods including the above-describedmethod.

The I/O unit 160 may include at least one selected from one button 161or two or more buttons 161, a microphone 162, a speaker 163, a vibrationmotor 164, the connector 165, a keypad 166, and the input pen 167.

Referring to FIGS. 1 and 5A, the button 161 includes a home button 161a, a menu button 161 b, and/or a back button 161 c provided in a lowerpart of the front surface 100 a of the portable apparatus 100. Thebutton 161 may include a power and/or lock button 161 d and at least onevolume button 161 e provided in sides thereof. The button 161 of theportable apparatus 100 may also include only the home button 161 a, thepower and/or lock button 161 d, and the volume button 161 e. The button161 of the portable apparatus 100 may be realized as a physical buttonor a touch button of the touch screen 190. Also, the button 161 of theportable apparatus 100 may be displayed in a text, image, or icon formon the touch screen 190. It will be easily understood by those skilledin the art that a shape, a location, a function, a name, etc. of thebutton 161 of FIGS. 1 and 5A is only an embodiment for descriptions andthus may be changed, modified, or revised without being limited thereto.

The microphone 162 receives a voice or a sound from an external sourceto generate an electrical signal under control of the controller 110.The electrical signal generated by the microphone 162 may be convertedthrough an audio codec and then stored in the storage unit 175 or outputthrough the speaker 163 under control of the controller 110. Referringto FIG. 5A, one microphone 162 or two or more microphones 162 may belocated in the front surface 100 a, a side 100 b, and/or the backsurface of the portable apparatus 100. One microphone 162 or two or moremicrophones 162 may be located only in the side 100 b of the portableapparatus 100.

The speaker 163 may output sounds corresponding to various types ofsignals (e.g., a wireless signal, a broadcast signal, an audio source, amoving image file, photo capturing, or the like) decoded by an audiocodec under control of the controller 110.

The speaker 163 may output a sound (e.g., a touch manipulation soundcorresponding to a phone number input or a photo capturing buttonmanipulation sound) corresponding to a function performed by theportable apparatus 100. Referring to FIGS. 1 and 5A, one speaker 163 ora plurality of speakers 163 may be located in the front surface 100 a,the side 100 b, and/or the back surface of the portable apparatus 100.One speaker 163 or a plurality of speakers 163 may be located in thefront surface 100 a of the portable apparatus 100. One speaker 163 maybe located in each of the front surface 100 a and the back surface ofthe portable apparatus 100. One speaker 163 a may be located in thefront surface 100 a of the portable apparatus 100, and a plurality ofspeakers (not shown) may be located in the back surface of the portableapparatus 100.

A plurality of speakers (not shown) may be located in the side 100 b ofthe portable apparatus 100. The portable apparatus 100 where anadditional speaker (not shown) is located in the side 100 b may providea user with a sound effect distinguished from another portable apparatus(not shown) where speakers are located in a front surface and a backsurface.

According to an embodiment of the present disclosure, the speaker 163may output an auditory feedback corresponding to a content changed inresponse to an increase in a visual fatigue. For example, the speaker163 may receive EEG information from the wearable apparatus 200 andanalyze the received EEG information to output an auditory feedbackcorresponding to a content changed in response to an increase in avisual fatigue under control of the controller 110.

The vibration motor 164 may convert an electrical signal into amechanical vibration under control of the controller 110. The vibrationmotor 164 may include a linear vibration motor, a bar type vibrationmotor, a coin type vibration motor, or a piezoelectric element vibrationmotor. For example, if a voice call request is received from anotherportable apparatus (not shown), the vibration motor 164 may operateunder control of the controller 110 in the portable apparatus 100 thatis in a vibration mode.

One vibration motor 164 or two or more vibration motors 164 may belocated in the portable apparatus 100. The vibration motor 164 may alsovibrate a whole part of the portable apparatus 100 or may locallyvibrate a part of the portable apparatus 100.

According to an embodiment of the present disclosure, the vibrationmotor 164 may output a haptic feedback corresponding to a contentchanged in response to an increase in a visual fatigue. For example, thevibration motor 164 may receive EEG information from the wearableapparatus 200 and analyze the received EEG information to output ahaptic feedback corresponding to a content changed in a response to anincrease in a visual fatigue under control of the controller 110. Thevibration motor 164 may also provide various types of haptic feedbacks(e.g., a strength and a duration time of vibrations) that are pre-storedor received from an external source based on a control command of thecontroller 110.

The connector 165 may be used as an interface for connecting theportable apparatus 100 to an external apparatus (not shown) or a powersource (not shown).

The portable apparatus 100 may transmit data (or a content) stored inthe storage unit 175 to an external source through a wired cableconnected to the connector 165 or receive the data (or the content) fromthe external source through the wired cable under control of thecontroller 110. The portable apparatus 100 may receive power from apower source (not shown) through a wired cable connected to theconnector 165 or charge a battery (not shown) from the power sourcethrough the wired cable under control of the controller 110. Theportable apparatus 100 may also be connected to an accessory (e.g., aspeaker (not shown) and a keyboard dock (not shown)) through theconnector 165.

The keypad 166 may receive a key input from the user to control theportable apparatus 100. The keypad 166 includes a physical keypad (notshown) formed in a front surface of the portable apparatus 100, avirtual keypad (not shown) displayed in the touch screen 190, and aphysical keypad (not shown) that is connectable by wireless or wired. Itwill be easily understood by those skilled in the art that the physicalkeypad formed in the front surface of the portable apparatus 100 may beexcluded according to a performance or a structure of the portableapparatus 100.

The input pen 167 may touch (or select) an object (e.g., a menu, a text,an image, a video, a figure, an icon, or a shortcut icon) displayed on(or configuring) a screen (e.g., a memo screen, a notepad screen, acalendar screen, or the like) displayed on the touch screen 190 or ahandwriting and/or drawing application of the portable apparatus 100 bythe user.

The input pen 167 may touch or select a content (e.g., a text file, animage file, an audio file, a video file, or a webpage) displayed on ascreen (e.g., a memo screen, a note screen, a calendar screen, or thelike) displayed on the touch screen 190 or a handwriting and/or drawingapplication of the portable apparatus 100 by the user.

The input pen 167 may perform handwriting or drawing (painting orsketching) on a screen of a handwriting or drawing application displayedon the touch screen 190 of the portable apparatus 100 by the user.

The input pen 167 may touch a capacitive type, resistive type, orelectromagnetic resonance (EMR) type touch screen or may input lettersor the like by using a displayed virtual keypad. The input pen 167 mayinclude a stylus pen or a haptic pen where an embedded vibration device(e.g., an actuator or a vibration motor) vibrates. The input pen 167 mayalso operate (e.g., vibrate) the vibration device in response to controlinformation received from the portable apparatus 100 and sensinginformation sensed by a sensor (e.g., an acceleration sensor (notshown)) embedded in the input pen 167.

If the input pen 167 is taken from an insertion hole (not shown), thecontroller 110 may execute a set handwriting and/or drawing applicationto display a screen (not shown) of the handwriting and/or drawingapplication on the touch screen 190.

The input pen 167 may include a finger (e.g., including a thumb) of theuser. For example, handwriting or drawing may be input by the user in anapplication displayed on a capacitive type or resistive type touchscreen.

If handwriting or drawing is input by a finger of the user in anapplication displayed on a capacitive type or resistive type touchscreen, the controller 110 may detect one touch of fingers including athumb by using the touch screen 190 and the touch screen controller 195.

It will be easily understood by those skilled in the art that a shape ofthe insertion hole (not shown) of the portable apparatus 100 and/or ashape (e.g., a circular cross-section or a polygonal cross-section) or astructure (e.g., a battery (not shown)) of the input pen 167 may bechanged according to a performance or a structure of the portableapparatus 100.

The sensor unit 170 may detect a status of the portable apparatus 100and/or a surrounding status of the portable apparatus 100. The sensorunit 170 may include one sensor or a plurality of sensors. For example,the sensor unit 170 may include a proximity sensor 171 that detects aproximity of the user to the portable apparatus 100, an illuminationsensor 172 that detects an amount of light around the portable apparatus100, and a gyro sensor 173 that detects a direction of the portableapparatus 100 by using rotational inertia of the portable apparatus 100.The sensor unit 170 may also include an acceleration sensor that detectsan acceleration of a triaxis (e.g., x, y, and z axes) applied to theportable apparatus 100, a gravity sensor that detects an actiondirection of gravity, or an altimeter that measures a pressure of air todetect an altitude.

The sensor unit 170 may measure a motion acceleration and a gravityacceleration of the portable apparatus 100. If the portable apparatus100 does not move, the sensor unit 170 may measure only the gravityacceleration. The sensor unit 170 may further include a fingerprintsensor (not shown) that detects a fingerprint of the user or a heartrate sensor that detects a heartbeat of the user.

At least one sensor included in the sensor unit 170 detects a status ofthe portable apparatus 100, generates an electrical signal correspondingto the detection, and transmits the electrical signal to the controller110. It will be easily understood by those skilled in the art that asensor included in the sensor unit 170 may be added, changed, or deletedaccording to a performance of the portable apparatus 100.

The storage unit 175 may store signals or data that are input and/oroutput in response to operations of the mobile communicator 120, the subcommunicator 130, the multimedia unit 140, the camera 150, the GPS 155,the I/O unit 160, the sensor unit 170, and the touch screen 190 undercontrol of the controller 110. The storage unit 175 may store a GUIrelated to a control program for controlling the portable apparatus 100or the controller 110 and an application provided by a manufacturer ordownloaded from an external source, images for providing the GUI, userinformation, documents, databases (DBs), or pieces of related data.

The storage unit 175 according to an embodiment of the presentdisclosure may store portable apparatus information, wearable apparatusinformation, or server information.

The storage unit 175 may store received wearable apparatus statusinformation.

The storage unit 175 may store first through third touches, firstthrough third touch locations, and first through third touch locationinformation.

The storage unit 175 may store a visual feedback (e.g., a video sourceor the like) that is output from the touch screen 190 in response to anincrease in a visual fatigue and is recognizable by the user, anauditory feedback (e.g., a sound source or the like) that is output fromthe speaker 163 and is recognizable by the user, and a haptic feedback(e.g., a haptic pattern or the like) that is output from the vibrationmotor 164 and is recognizable by the user.

The storage unit 175 may store a feedback providing time (e.g., 300msec) of a feedback provided to the user.

The term “storage unit” used herein includes the storage unit 175, theROM 112 or the RAM 113 of the controller 110, or a memory card (notshown) (e.g., a micro secure digital (SD) card, a memory stick, or thelike) installed in the portable apparatus 100. The storage unit mayinclude a nonvolatile memory, a volatile memory, a hard disk drive(HDD), or a solid state drive (SSD).

The power supply unit 180 may supply power to elements 120 through 195located in the portable apparatus 100 under control of the controller110. The power supply unit 180 may supply elements of the portableapparatus 100 with power, which is input from a power source (not shown)through a wired cable (not shown) connected to the connector 165, undercontrol of the controller 110. The power supply unit 180 may also supplypower to one battery or two or more batteries (not shown) to charge theone battery or the two or more batteries under control of the controller110. The one battery or the two or more batteries may be located betweenthe touch screen 190 located in the front surface 100 a and the backsurface.

The power supply unit 180 may wirelessly charge one battery or two ormore batteries (not shown) (e.g., according to a magnetic resonancemethod, an electromagnetic wave method, or a magnetic induction method)under control of the controller 110.

The touch screen 190 includes a touch panel (not shown) that receives atouch input and a display panel (not shown) that displays a screen. Thetouch screen 190 may provide the user with GUIs corresponding to varioustypes of services (e.g., a voice call, a video call, a datatransmission, a broadcast reception, photo capturing, a moving imageview, an application execution, etc.). The touch screen 190 transmits ananalog signal, which corresponds to a single touch or a multi touchinput through the home screen 191 or a GUI, to the touch screencontroller 195. The touch screen 190 may receive a single touch or amulti touch through a body of the user (e.g., fingers including a thumb)or the input pen 167.

The display panel (not shown) includes a plurality of pixels anddisplays an image through the plurality of pixels. For example, thedisplay panel may include a liquid crystal display (LCD), an LED, anOLED, or the like. The display panel may display various operationstatuses of the portable apparatus 100, and various types of images anda plurality of objects depending on an execution of an application or aservice.

In various embodiments of the present disclosure, a touch is not limitedto a touch of the body of the user or the input pen 167 on the touchscreen 190 but includes a non-touch of the body of the user or the inputpen 167 on the touch screen 190. For example, the non-touch may includehovering where a distance between the touch screen 190 and the body ofthe user or the input pen 167 is lower than or equal to 50 mm. It willbe easily understood by those skilled in the art that a non-touchdistance detectable from the touch screen 190 may be changed accordingto a performance or a structure of the portable apparatus 100.

The touch screen 190 may, for example, be realized as a resistive type,a capacitive type, an infrared type, or an acoustic wave type.

The touch screen 190 may include an EMR type. The EMR type touch screenmay further include an additional EMR type touch panel (not shown) thatreceives an input of an input pen (not shown) having a resonance circuitresonating in an EMR type loop coil.

The touch screen 190 according to an embodiment of the presentdisclosure may output a visual feedback corresponding to a contentchanged in response to an increase in a visual fatigue. The touch screen190 may receive EEG information from the wearable apparatus 200 andanalyze the received EEG information to display a visual feedbackcorresponding to a content changed in response to an increase in avisual fatigue under control of the controller 110.

In the various embodiments of the present disclosure, a display unit mayinclude the touch screen 190.

The touch screen controller 195 converts an analog signal correspondingto a single touch or a multi touch, which is received from the touchscreen 190, into a digital signal and transmits the digital signal tothe controller 110. The controller 110 may calculate X coordinates and Ycoordinates corresponding to a touch location on the touch screen 190 byusing the digital signal received from the touch screen controller 195.

The controller110 may control the touch screen 190 by using the digitalsignal received from the touch screen controller 195. For example, thecontroller 110 may display a shortcut icon (e.g., denoted by referencenumeral 193 a of FIG. 5A) displayed on the touch screen 190 so as toenable the shortcut icon 193 a to be distinguished from other shortcuticons (e.g., denoted by reference numerals 193 b through 193 h) orexecute an application (e.g., a call) corresponding to the selectedshortcut icon 193 a of FIG. 5A to display an application screen inresponse to an input touch.

The touch screen controller 195 may be realized as one touch screencontroller 195 or a plurality of touch screen controllers 195. The touchscreen controller 195 may be included in the controller 110 according toa performance or a structure of the portable apparatus 100.

The touch screen controller 195 converts an analog signal into a digitalsignal and transmits the digital signal to the controller 110, whereinthe analog signal corresponds to a touch received from an EMR type touchscreen separately from an analog signal corresponding to a single touchor a multi touch received from the touch screen 190. The controller 110may calculate X and Y coordinates corresponding to a touch location onan EMR type touch screen by using the digital signal received from thetouch screen controller 195. The EMR type touch screen may also use anEMR type touch screen controller (not shown).

The portable apparatus 100 has been illustrated as including only onetouch screen in FIGS. 1 and 2 but may include a plurality of touchscreens. The plurality of touch screens may be respectively located inhousings (not shown), and the housings may be connected to one anotherby a hinge (not shown). Also, a plurality of flexible touch screens maybe located in one housing (not shown). The plurality of flexible touchscreens may include one display panel and a plurality of touch panels.The plurality of flexible touch screens may include one touch panelcorresponding to a plurality of display panels. The plurality offlexible touch screens may also include a plurality of touch panelscorresponding to a plurality of display panels.

It will be easily understood by those skilled in the art that at leastone element of the portable apparatus 100 of FIG. 2 may be added,delete, or changed in response to a performance of the portableapparatus 100.

Referring to FIGS. 1 and 2, the wearable apparatus 200 may be connectedto the portable apparatus 100 or the server 300 by wire or wirelessly byusing a communicator 230.

The wearable apparatus 200 according to an embodiment of the presentdisclosure may refer to an apparatus that may detect bio-information(e.g., EEG of the user). For example, the bio-information of the usermay include EEG, a body temperature, a heartbeat, a pulse ratevariation, a blood pressure, a blood glucose, breath information, anoxygen saturation, a skin state, a motion amount, stress, a stressindex, sleep information, etc. Also, the wearable apparatus 200 mayrefer to an apparatus that may transmit detected EEG to the portableapparatus 100 and/or the server 300. For example, the wearable apparatus200 that detects the EEG of the user may include a headband typewearable apparatus, a cap type wearable apparatus, a hat type wearableapparatus, a headset type wearable apparatus, a headphone type wearableapparatus, or the like.

The wearable apparatus 200 may be connected to the portable apparatus100 or the server 300 by using the communicator 230. The wearableapparatus 200 may detect EEG of the user by using a touch type or anon-touch type sensor 270 under control of a controller 210.

The wearable apparatus 200 may include the controller 210, thecommunicator 230, an I/O unit 260, the sensor 270, a storage unit 275, abattery 280, and a display unit 290.

The controller 210 may include a processor 211, a ROM 212 that stores acontrol program for controlling the wearable apparatus 200, and a RAM213 that stores a signal or data input from an outside of the wearableapparatus 200 and is used as a storage area for various types of jobsperformed in the wearable apparatus 200.

The controller 210 controls an overall operation of the wearableapparatus 200 and a signal flow between internal elements 220 through290 of the wearable apparatus 200 and performs a function of processingdata. The controller 210 may control the battery 280 to supply power tothe internal elements 220 through 290 or interrupt power supplied to theinternal elements 220 through 290. Also, if an input of the user or apreset condition is satisfied, the controller 210 may operate the sensor270.

The processor 211 may include a GPU (not shown) for graphic processing.The processor 211 may be realized as a SoC type including a core (notshown) and a GPU (not shown). The processor 211 may include a singlecore, a dual core, a triple core, a quad core, and a multiple core.Also, the processor 211, the ROM 212, and the RAM 213 may be connectedto one another through a bus.

The controller 210 may control the communicator 230, the I/O unit 260,the sensor 270, the storage unit 275, the battery 280, and the displayunit 290.

The controller 210 according to an embodiment of the present disclosuremay detect EEG of the user by using the sensor 270 or may detect astatus of the wearable apparatus 200 through an additional sensor (notshown).

The controller 210 may transmit EEG information of the usercorresponding to the detected EEG of the user to the portable apparatus100 or the server 300 through the communicator 230.

The controller 210 may control to transmit changed wearable apparatusstatus information to the portable apparatus 100 by using thecommunicator 230 and stored portable apparatus information.

The term “controller 210 of the wearable apparatus 200” used hereinincludes the processor 211, the ROM 212, and the RAM 213.

The communicator 230 may be connected to the portable apparatus 100 orthe server 300 by using a wireless LAN 231 and/or a short-rangecommunicator 232. The communicator 230 may transmit the EEG informationof the user to the portable apparatus 100 or the server 300 undercontrol of the controller 210.

The communicator 230 may include the wireless LAN 231 and/or theshort-range communicator 232. For example, the communicator 230 mayinclude one or both of the wireless LAN 231 and the short-rangecommunicator 232. The communicator 230 may further include wiredEthernet.

The wireless LAN 231 may be wirelessly connected to an AP in aninstallation place of the AP under control of the controller 210. Forexample, the wireless LAN 231 may include Wi-Fi. The wireless LAN 231supports the wireless LAN standard IEEE 802.11x of IEEE. The short-rangecommunicator 232 may wirelessly perform a short-range communicationbetween the portable apparatus 100 and an external apparatus without theAP under control of the controller 210. The short-range communicationmay include Bluetooth, Bluetooth low energy, IrDA, UWB, an NFC, etc.

The communicator 230 may transmit the EEG of the user detected by (orstored in) the sensor 270 to the portable apparatus 100 or the server300 under control of the controller 210. The communicator 230 mayperiodically (e.g., 500 msec that is changeable) transmit the EEG of theuser detected by (or stored in) the sensor 270 to the portable apparatus100 or the server 300 under control of the controller 210. Thecommunicator 230 may also receive a transmission request of the detected(or stored) EEG of the user or wearable apparatus status informationfrom the portable apparatus 100 and/or the server 300.

The wearable apparatus 200 may be connected to another externalapparatus (e.g., a wireless speaker, a wireless headset, another userEEG detecting apparatus, or the like) by using the communicator 230.

The wearable apparatus 200 may also include a mobile communicator (notshown). The mobile communicator of the wearable apparatus 200 maytransmit and/or receive a wireless signal for a voice call, a videocall, an SMS, an MMS, and a data communication with a portable phone(not shown) having a connectable phone number, a smartphone (not shown),a tablet PC, a tablet apparatus, or another portable apparatus (notshown).

The wearable apparatus 200 may include a camera (not shown) capturing astill image or a moving image under control of the controller 210. Thecamera may be located in a front surface (e.g., a forehead area of theuser) of the wearable apparatus 200.

The wearable apparatus 200 may include a GPS (not shown). The wearableapparatus 200 may calculate a current location of an outdoor wearableapparatus 200 by using the GPS and calculate a location of an indoorwearable apparatus 200 by using an AP.

The I/O unit 260 may include at least one selected from one button ortwo or more buttons (not shown), a microphone (not shown), a speaker(not shown), a vibration motor (not shown), and a connector (not shown).

The button (not shown) includes a power button. The button may include avolume button (not shown) or a back button (not shown). The button mayalso include a touch button.

The microphone (not shown) receives a voice or a sound from an externalsource to generate an electrical signal under control of the controller210.

The speaker (not shown) may output a sound corresponding to a functionor an operation performed in the wearable apparatus 200 under control ofthe controller 210.

The vibration motor (not shown) may output a vibration corresponding toa function or an operation performed in the wearable apparatus 200 undercontrol of the controller 210.

The connector (not shown) may transmit data (e.g., EEG of the user orthe like) stored in the storage unit 275 of the wearable apparatus 200to an external source or may charge the battery 280 under control of thecontroller 210.

The sensor 270 may detect EEG of the user under control of thecontroller 210. The sensor 270 may include a plurality of electrodes.The sensor unit 270 may detect the EEG through the plurality ofelectrodes. A material of the electrodes may include a conductive fiber(e.g., a silver fiber), a conductive polymer (e.g., polyethylene,polyparaphenylene, polyphenol, polyaniline, or the like), or a metalcoated with highly conductive metal. The sensor unit 270 may detect apotential difference occurring from the plurality of electrodes. An EEGmeasurement may be similar to a voltage measurement having a very largeimpedance (e.g., a high resistance). EEG data detected by the sensor 270may be transmitted to the controller 210. For example, the EEG data mayinclude analog data that is raw data or digital data that is acquired byprocessing raw data. The detected EEG data may be stored in the storageunit 275 under control of the controller 210.

EEG of the user may refer to a current that appears according to a brainactivity or waveforms that are acquired by driving, amplifying, andrecording the current. Types of EEG vibrating in complicated patternsmay be classified into a delta (δ) wave between 0.2 Hz and 3.99 Hz, atheta (θ) wave between 4 Hz and 7.99 Hz, an alpha (α) wave between 8 Hzand 12 Hz, a beta (β) wave between 13 Hz and 29.99 Hz, and a gamma (γ)wave between 30 Hz and 50 Hz. It will be easily understood by thoseskilled in the art that a frequency band of the above-described EEG isone embodiment and thus may be changed by a surrounding environment anda detecting apparatus.

The δ wave may be remarkably detected from a user who is in deep sleepor a newborn baby. The θ wave may be mainly detected from a child whoenters an emotional stability or sleep. The α wave may be mainlydetected in a comfortable status such as tension relaxation. The β wavemay be mainly detected from a frontal region of the user, i.e., may bedetected when the user is awake or performs a conscious activity such asspeaking. The (γ) wave may vibrate faster than the (β) wave and may bedetected when the user is in an impatient state or processes high-levelcognitive information.

The sensor 270 may also detect an internal status or an external statusof the wearable apparatus 200. Also, the sensor 270 may detect a changein the internal status or the external status of the wearable apparatus200 under control of the controller 210. For example, the sensor 270 mayinclude an acceleration sensor (not shown) that detects an accelerationof tri-axis (e.g., x, y, and z axes) applied to the wearable apparatus200 or a gyro sensor (not shown) that detects a direction of thewearable apparatus 200 by using rotational inertia of the wearableapparatus 200. It will be easily understood by those skilled in the artthat a sensor included in the sensor 270 may be added, changed, ordeleted according to a performance of the wearable apparatus 200.

The storage unit 275 may store signals or data that are input and/oroutput to correspond to operations of the communicator 230, the I/O unit260, the sensor 270, and the display unit 290 under control of thecontroller 210. The storage unit 275 may store a GUI related to acontrol program for controlling the wearable apparatus 200 or thecontroller 210 and an application provided by a manufacturer ordownloaded from an external source, images for providing the GUI, userinformation, documents, DBs, or pieces of related data.

The storage unit 275 may store data related to an operation of thewearable apparatus 200 or environment information (e.g., a temperature,an acceleration, an illumination intensity, or the like) or statusinformation (e.g. power on, an operation, or the like) detected by thesensor 270 under control of the controller 210.

The storage unit 275 may store EEG data detected by the sensor 270.

The storage unit 275 may store EEG information of the user including atleast one selected from raw data and digital data.

The storage unit 275 may store wearable apparatus informationcorresponding to the wearable apparatus 200, portable apparatusinformation corresponding to the portable apparatus 100, or serverinformation corresponding to the server 300. For example, it will beeasily understood by those skilled in the art that apparatus informationmay include a plurality of items indicating an identification (ID) for ahistory management, an apparatus ID, an apparatus name, an apparatusURI, and an apparatus status but may include items indicating variousstatuses of an apparatus without being limited thereto.

The battery 280 may supply power to internal elements 230 through 290 ofthe wearable apparatus 200 under control of the controller 210. A powersupply unit (not shown) may supply the wearable apparatus 200 with powerthat is input from an external power source (not shown) through a wiredcable (not shown) connected to a connector (not shown) under control ofthe controller 210. The power supply unit may also charge the onebattery 280 or two or more batteries 280 with power that is suppliedunder control of the controller 210.

The power supply unit may wirelessly (e.g., according to a magneticresonance method, an electromagnetic method, or a magnetic inductionmethod) charge one battery 280 or two or more batteries 280 undercontrol of the controller 210.

The display unit 290 may provide the user with a GUI corresponding tovarious types of services (e.g., a voice call, a video call, a datatransmission, a broadcast reception, photo capturing, a moving imageview, an application execution, etc.) under control of the controller210. A display panel (not shown) includes a plurality of pixels anddisplays an image through the pixels. For example, the display panel maybe realized as an LCD, an OLED, an LED, or the like. The display panelmay display various types of images and a plurality of objects accordingto various types of statuses, applications, or service executions of thewearable apparatus 200.

The display unit 290 may include a touch screen (not shown) including adisplay panel (not shown) and a touch panel (not shown). The touchscreen may be realized as a resistive type, a capacitive type, aninfrared type, or an acoustic wave type.

According to an embodiment of the present disclosure, the display unit290 may output a visual feedback corresponding to a user EEG detectionunder control of the controller 210.

It will be easily understood by those skilled in the art that theportable apparatus 100 and the wearable apparatus 200 are classified inFIGS. 1 and 2, but a plurality of portable apparatuses (e.g., tabletapparatuses 1 and 2) having the same types may be embodied.

It will be easily understood by those skilled in the art that at leastone selected from elements of the wearable apparatus 200 shown in FIG. 2may be added, changed, or deleted according to a performance of thewearable apparatus 200.

Referring to FIG. 2, the server 300 may be connected to at least oneselected from the portable apparatus 100 and the wearable apparatus 200through a communicator (not shown) by a wireless or wired connection.The server 300 may request status information from the wearableapparatus 200. The server 300 may receive status information from thewearable apparatus 200. The server 300 may receive a requestcorresponding to a transmission of the status information of thewearable apparatus 200 from the portable apparatus 100. The server 300may transmit the status information of the wearable apparatus 200 to theportable apparatus 100.

In various embodiments of the present disclosure, the server 300 mayrefer to a computing apparatus that may store EEG data received from thewearable apparatus 200 and transmit the stored EEG data to the portableapparatus 100. The server 300 may refer to a computing apparatus thatmay store EEG data from the wearable apparatus 200 and calculate avisual fatigue by using the stored EEG data.

The server 300 may also refer to a computing apparatus that may storestatus information of the wearable apparatus 200 received from thewearable apparatus 200 and transmit the stored status information of thewearable apparatus 200 to the portable apparatus 100. The server 300 mayinclude a gateway (not shown), a home network server (not shown) or acloud server (not shown). A display apparatus (not shown) or arefrigerator (not shown) may act as the server 300 in a home networkenvironment.

It will be easily understood by those skilled in the art that at leastone element of the server 300 of FIGS. 1 and 2 may be added, changed, ordeleted according to a performance of the server 300.

FIGS. 3A and 3B are schematic perspective views of a wearable apparatusaccording to an embodiment of the present disclosure.

Referring to FIGS. 3A and 3B, the wearable apparatus 200 that is worn ona head of a user may be realized in a ring shape. The ring shape mayinclude a concentric circle or an ellipse. The wearable apparatus 200may be realized in a polygon having three or more vertexes. The wearableapparatus 200 may also be realized as a headband type wearableapparatus, a headset type wearable apparatus, or a helmet type wearableapparatus. It will be easily understood by those skilled in the art thatthe wearable apparatus 200 may be realized in various shapes or typesbesides the above-mentioned types of wearable apparatuses to detect EEGof the user.

A body 200 a of the wearable apparatus 200 may be formed of a highmolecular compound, metal, fiber, or ceramics. A size (e.g., a diameter)of the body 200 a of the wearable apparatus 200 having elasticity mayvary according to whether to wear or do not wear the body 200 a of thewearable apparatus 200. The wearable apparatus 200 may have variousdiameters in response to a size of a head of the user. For example, thewearable apparatus 200 may be classified as infant, child, youth, oradult.

Some of the elements 210 through 290 shown in FIG. 2 may be located inthe body 200 a of the wearable apparatus 200. A button of the I/O unit260 or the display unit 290 may be exposed to an outside of the body 200a of the wearable apparatus 200. Also, the sensor 270 may be exposed toan outside of the wearable apparatus 200.

One electrode or a plurality of electrodes 271 and 272 may be exposed inan internal side 200 a 1 of the body 200 a in the wearable apparatus200. The sensor 270 may include a measurement electrode 271 that detectsEEG and a reference electrode 272 (e.g., ground). A structure of themeasurement electrode 271 and a structure of the reference electrode 272are the same, and thus their repeated descriptions are omitted.

A material of the measurement electrode 271 may include a conductivefiber (e.g., a silver fiber), conductive polymer (e.g., polyacetylene,polyparaphenelene, polyphenol, polyaniline, or the like), or metalcoated with conductive metal.

The measurement electrode 271 may contact a body (e.g., a head) of theuser. The measurement electrode 271 may have a base 271 a and oneprotrusion 271 a 1. The protrusion 271 a 1 of the measurement electrode271 may have elasticity.

If the protrusion 271 a 1 having elasticity contacts the body of theuser, the protrusion 271 a 1 may be bent in response to a movementdirection of the wearable apparatus 200. For example, if the wearableapparatus 200 is worn on the user, the protrusion 271 a 1 may be bent inan opposite direction to the movement direction (e.g., a wearingdirection) of the wearable apparatus 200. Also, if the wearableapparatus 200 is separated from the body of the user, the protrusion 271a 1 may return to the opposite direction to the movement direction ofthe wearable apparatus 200.

Locations of the measurement electrode 271 and the reference electrode272 in the wearable apparatus 200 may vary according to the number ofmeasurement electrodes 271 and the reference electrodes 272 of thewearable apparatus 200. A location of the measurement electrode 271 thatmeasures EEG of the user and a location of the reference electrode 272may be determined based on an activation degree of a visual cortex and afrontal lobe recognizing and processing the activation degree of thevisual cortex.

Table 1 below shows examples of a location of the measurement electrode271 and a location of the reference electrode 272 corresponding to thenumber of measurement electrodes 271 in the wearable apparatus 200.

TABLE 1 Number of Measurement Location of Location of ElectrodesMeasurement Electrode Reference Electrode 2 Central Area of Ear Area,Both Ear Forehead, Central Area Areas of Back of the Head 3 Both AreasBased on Ear Area, Both Ear Central Area of Areas Forehead, Central Areaof Back of the Head

As shown in FIG. 3A, if the number of measurement electrodes 271 is 2,the measurement electrodes 271 may be located in a central area of aforehead (e.g., a frontal bone area or a glabella area corresponding toa frontal lobe) and a central area of a back of the head (e.g., anoccipital bone area corresponding to an occipital lobe). The referenceelectrodes 272 may be located in an ear area (e.g., a temporal bonecorresponding to a temporal lobe) or both ear areas.

The locations of the measurement electrodes 271 and the locations of thereference electrodes 272 may intersect with each other (e.g., at anangle between 45° and 135°). Locations of a plurality of measurementelectrodes face one another. Also, the reference electrodes 272 faceeach other. The reference electrodes 272 may intersect with one another(e.g., at an angle between 45° and 135°).

As shown in FIG. 3B, if the number of measurement electrodes 271 is 3,one of the measurement electrodes 271 may be located in the central areaof the forehead (e.g., the frontal bone area or the glabella areacorresponding to the frontal lobe), and two of the measurementelectrodes 271 may be located in the central area of the back of thehead (e.g., the occipital area corresponding to the occipital lobe). Thereference electrodes 272 may be located in the ear area (e.g., thetemporal bone corresponding to the temporal lobe) or both ear areas.

The locations of the measurement electrodes 271 may intersect with thelocations of the reference electrodes 272. A plurality of measurementelectrodes 271 that are located in the back of the head based on avirtual extension line that is connected from the measurement electrode271 located in the forehead toward the back of the head may be locatedat the same intervals (e.g., on left and right sides). Also, locationsof a plurality of reference electrodes 272 face one another. Thereference electrodes 272 may intersect with one another (e.g., at anangle between 45° and 135°).

If the number of measurement electrodes 271 increases, the measurementelectrodes 271 may be located in a top area of the head (e.g., aparietal bone area corresponding to a parietal lobe).

It will be easily understood by those skilled in the art that Table 1above does not limit the number of measurement electrodes 271, locationsof the measurement electrodes 271, and locations of the referenceelectrodes 272 to the above-described items but may indicate variouscombinations of locations of the measurement electrodes 271 andlocations of the reference electrodes 272 corresponding to the number ofmeasurement electrodes 271.

FIG. 4 is a schematic flowchart of a method of changing a content screenof a portable apparatus according to an embodiment of the presentdisclosure.

FIGS. 5A to 12B illustrate a screen of a portable apparatus according tovarious embodiments of the present disclosure.

Referring to FIG. 4, an application is executed in the portableapparatus in operation S410.

Referring to FIG. 5A, the portable apparatus 100 may display anapplication (e.g., corresponding to shortcut icons 193 a through 193 i)or a widget 194 on a home screen 191 distinguished from a status bar192. Also, a user wears the wearable apparatus 200. For example, thewearable apparatus 200 may be worn on a head of the user.

The user may perform a first touch (501) on the shortcut icon 193 gcorresponding to a visual fatigue application (e.g., Smart-eye) that isa selection target of the shortcut icons 193 a through 193 i displayedon a screen of the portable apparatus 100. It will be easily understoodby those skilled in the art that a calculation of a visual fatigue of auser may be embodied as a visual fatigue calculation application, avisual fatigue OS, or visual fatigue calculation middleware.

The controller 110 may detect the first touch 501 by using the touchscreen 190 and the touch screen controller 195. The controller 110 maycalculate a first touch location 501 a (e.g., X1 and Y1 coordinates)corresponding to the first touch 501 by using an electrical signalreceived from the touch screen controller 195.

The controller 110 may store first touch location informationcorresponding to the first touch location 501 in the storage unit 175.The stored first touch location information may include a touch ID for ahistory management, a touch location, a touch detection time, or touchinformation (e.g., a touch pressure, a touch direction, a touch durationtime, or the like).

The controller 110 may also or alternatively detect a first hovering(not shown) by using the touch screen 190 and the touch screencontroller 195. The controller 110 may calculate a first hoveringlocation (not shown) (e.g., X11 and Y11 coordinates) corresponding tothe first hovering by using an electrical signal received from the touchscreen controller 195.

The controller 110 may store first hovering location informationcorresponding to the first hovering location in the storage unit 175.The stored first hovering location information may include a hovering IDfor a history management, a hovering detection location, a hoveringdetection time, or hovering information (e.g., a hovering height h, ahovering direction, a hovering duration time, or the like).

A touch of the input pen 167 is a single point touch. The controller 110may detect the touch of the input pen 167 as the single point touch.Also, the controller 110 may determine a touch of an EMR type input pen(not shown) through a second touch panel (not shown). The controller 110may determine a touch of an input pen (e.g., a capacitive type inputpen), which is not an EMR type, according to a single point touch.

Referring to FIG. 5B, the controller 110 of the portable apparatus 100may display an application (e.g., Smart-eye) screen 600 corresponding tothe first touch 501 on a screen of the portable apparatus 100. Theapplication screen 600 displayed to correspond to the first touch 501may include a home screen of an application.

The home screen 600 of the application may include may include anintroduction area 601 that introduces the application (e.g., Smart-eye)and an interaction area 602 that receives an interaction (e.g., a touch,a touch gesture input, or the like) between the application and theuser. The interaction area 602 may display a button 602 a correspondingto “connect the headband” and/or a button 602 b corresponding to “startchecking EEG . . . ” corresponding to a visual fatigue.

FIGS. 12A to 12C illustrate an environment setting screen of a portableapparatus according to an embodiment of the present disclosure.

Referring to FIGS. 12A to 12C, if a user selects a shortcut icon 600 acorresponding to an environment setting located on a top of the homescreen 600 of the application, the controller 110 may display anenvironment setting screen 800 as shown in FIG. 12A. If the user selectsthe shortcut icon 600 a, the controller 110 may change the home screen600 of the application into the environment setting screen 800corresponding to a visual fatigue.

Visual fatigue settings menu 800 a displayed on the environment settingscreen 800 may include selections to address visual fatigue related toan application 801, which addresses a visual fatigue according to eachapplication, or related to a time zone 802, which addresses a visualfatigue according to time. It will be easily understood by those skilledin the art that the items displayed on the environment setting screen800 may be changed or deleted according to a function and/or aperformance of the portable apparatus 100.

If the user selects the application 801 that is a menu for setting thevisual fatigue according to applications, the controller 110 may displaya visual fatigue setting screen 810 according to each application.

FIG. 12B illustrates an example of the visual fatigue setting screen 810according to each application. Referring to FIG. 12B, items displayed onthe visual fatigue setting screen 810 according to each application mayinclude an e-book 811, a web browser 812, a video player 813, a game814, a magazine 815, or a social network system 816. The user may selectthe items 811 through 816 and set a detailed environment to be providedin the event of visual fatigue. For example, if the user selects the webbrowser 812, the user may set a detailed visual fatigue environment ofthe web browser 812. The setting of the detailed visual fatigueenvironment of the web browser 812 may include an ocular movement guide812 a, a font change 812 b, and a content UI change 812 c. The settingof the detailed visual fatigue environment of the web browser 812 mayfurther include a color screen (e.g., a color filter) control, aluminance control, a color control, a chroma control, etc.

It will be easily understood by those skilled in the art that items(e.g., applications 811 through 816 or visual fatigue correspondingitems 812 a through 812 c) displayed on the visual fatigue settingscreen 810 according to each application may be added, changed, ordeleted according to a function and/or a performance of the portableapparatus 100.

If the user selects the time zone 802, the controller 110 may display avisual fatigue setting screen 820 according to each time zone. FIG. 12Cillustrates an example of a visual fatigue setting screen 820 forsetting a visual fatigue according to time zone. Referring to FIG. 12C,items displayed on the visual fatigue setting screen 820 according toeach time zone may include a time zone 821 between 8 o'clock and 17o'clock and a time zone 822 between 17 o'clock and 24 o'clock. The usermay select the items 821 and 822 and set a detailed environment. Forexample, if the user selects the time zone 822 between 17 o'clock and 24o'clock, the user may set a detailed visual fatigue environment of thetime zone 822 between 17 o'clock and 24 o'clock. The setting of thedetailed visual fatigue environment of the time zone between 17 o'clockand 24 o'clock may include an ocular movement guide 822 a, a font change822 b, and a content UI change 822 c.

It will be easily understood by those skilled in the art that the items(e.g., the time zones 821 and 822) displayed on the visual fatiguesetting screen 820 according to each time zone and the items 822 athrough 822 c corresponding to a visual fatigue may be added, changed,or deleted according to a function and/or a performance of the portableapparatus 100.

In operation S420 of FIG. 4, a wearable apparatus is connected.

Referring to FIG. 5B, the user may perform a second touch 502 on thebutton 602 a corresponding to “connect the headband” on the hone screen600 of the application (e.g., Smart-eye).

The controller 110 may detect the second touch 502 by using the touchscreen 190 and the touch screen controller 195. The controller 110 maycalculate a second touch location 502 a (e.g., X2 and Y2 coordinates)corresponding to the second touch 502 by using an electrical signalreceived from the touch screen controller 195.

The controller 110 may store second touch location informationcorresponding to the second touch location 502 a in the storage unit175. The stored second touch location information may include a touch IDfor a history management, a touch location, a touch detection time, ortouch information (e.g., a touch pressure, a touch direction, a touchduration time, or the like).

A detection of a second hovering performed in operation S420 of FIG. 4is similar to a detection of first hovering performed in operation S410of FIG. 4, and thus a repeated description thereof is omitted.

The controller 110 of the portable apparatus 100 may search for thewearable apparatus 200 around the portable apparatus 100 by using acommunicator. The wearable apparatus 200 that is a connection target maybe selected from a search list (not shown) corresponding to a searchresult of a wearable apparatus displayed on the screen of the portableapparatus 100. The wearable apparatus 200 that is the connection targetmay be selected by the user or the controller 110. If only the wearableapparatus 200 that is the connection target is searched from the searchlist, the controller 110 may select the wearable apparatus 200 that isthe connection target without a user input.

The controller 110 of the portable apparatus 100 may be connected to acommunicator of the wearable apparatus 200 through a first wirelesscommunication by using a communicator in response to the selection. Forexample, the first wireless communication may be a wirelesscommunication (e.g., a short-range communication) having a limitedtransmission distance (e.g., a distance lower than or equal to 1 m,lower than or equal to 50 m, or lower than or equal to 100 m). Theportable apparatus 100 and the wearable apparatus 200 may be connectedto each other through the first wireless communication having thelimited transmission distance. The first wireless communication may be ashort-range wireless communication but is not limited thereto. A secondwireless communication may be a long-range wireless communication, e.g.,may be a mobile communication, but is not limited thereto.

If the portable apparatus 100 and the wearable apparatus 200 areconnected to each other through Bluetooth that is one of first wirelesscommunications, the portable apparatus 100 and the wearable apparatus200 may be connected to each other through a mutual support profile(e.g, a serial port profile (SPP), an advanced audio distributionprofile (A2DP), an audio/video remote control profile (AVRCP), or ahands-free profile (HFP)). Also, the portable apparatus 100 and thewearable apparatus 200 may be connected to each other through Wi-Fi thatis one of first wireless communications. It will be easily understood bythose skilled in the art that the above-described profile is only anexample, and a profile mutually supporting the portable apparatus 100and the wearable apparatus 200 may be added, changed, or deleted.

If the portable apparatus 100 and the wearable apparatus 200 areconnected to each other, the controller 110 of the portable apparatus100 may store wearable apparatus information received from the wearableapparatus 200 in the storage unit 175. The stored wearable apparatusinformation may include wireless connection information (e.g., asubsystem identification (SSID), an Internet protocol (IP) address, anmedia access control (MAC) address, a channel number, a security key, orthe like), a product name of the wearable apparatus 200, an ID of thewearable apparatus 200, an MAC address of the wearable apparatus 200, atype of the wearable apparatus 200, a profile of the wearable apparatus200, a communication method of the wearable apparatus 200, etc.

If the portable apparatus 100 and the wearable apparatus 200 areconnected to each other, the controller 210 of the wearable apparatus200 may store portable apparatus information received from the portableapparatus 100 in the storage unit 275. The portable apparatusinformation stored in the storage unit 275 of the wearable apparatus 200is similar to the wearable apparatus information stored in the storageunit 175 of the portable apparatus 100, and thus a repeated descriptionthereof is omitted.

If the portable apparatus 100 and the wearable apparatus 200 areconnected to each other, the controller 110 of the portable apparatus100 may request a current status from the wearable apparatus 200. Thecurrent status of the wearable apparatus 200 may include an operationstatus (e.g., a working or busy status), a standby status, a sleepstatus, or a hold status.

In various embodiments of the present disclosure, the current status ofthe wearable apparatus 200 may be the standby status.

The controller 210 of the wearable apparatus 200 may transmit wearableapparatus status information to the portable apparatus 100 through thecommunicator 230 in response to a request. The controller 110 of theportable apparatus 100 may store the received wearable apparatus statusinformation in the storage unit 175.

If the portable apparatus 100 and the wearable apparatus 200 areconnected to each other, the controller 110 of the portable apparatus100 may display the home screen 600 of the application.

According to an embodiment of the present disclosure, the controller 210of the wearable apparatus 200 that is turned on may search for theportable apparatus 100 around the wearable apparatus 200 by using thecommunicator 230. The portable apparatus 100 may be selected from asearch list (not shown) corresponding to a search result of the portableapparatus 100 displayed on the display unit 290 of the wearableapparatus 200. The portable apparatus 100 that is a connection targetmay be selected by the user or the controller 210. If only the portableapparatus 100 that is the connection target is searched from thedisplayed search list, the controller 210 may select the portableapparatus 100 that is the connection target without a user input.

The controller 210 of the wearable apparatus 200 may be wirelesslyconnected to a communicator of the portable apparatus 100 by using thecommunicator 230 in response to the selection.

If the portable apparatus 100 and the wearable apparatus 200 areconnected to each other, the controller 210 of the wearable apparatus200 may store portable apparatus information received from the portableapparatus 100 in the storage unit 275. The stored portable apparatusinformation may include wireless connection information (e.g., an SSID,an IP address, a channel number, a security key, or the like), a productname of the portable apparatus 100, an ID of the portable apparatus 100,an MAC address of the portable apparatus 100, a type of the portableapparatus 100, a profile of the portable apparatus 100, a communicationmethod of the portable apparatus 100, etc.

In operation S430 of FIG. 4, the measuring of a visual fatigue starts.

A method of measuring and calculating the visual fatigue will bedescribed in greater detail later.

Referring to FIG. 5B, the user may perform a third touch 503 on thebutton 602 b corresponding to “start checking a visual fatigue . . . ”on the home screen 600 of the application (e.g., Smart-eye).

The controller 110 may detect the third touch 503 by using the touchscreen 190 and the touch screen controller 195. The controller 110 maycalculate a third touch location 503 a (e.g., X3 and Y3 coordinates)corresponding to the third touch 503 by using an electrical signalreceived from the touch screen controller 195.

The controller 110 may store third touch location informationcorresponding to the third touch location 503 a in the storage unit 175.The stored third touch location information may include a touch ID for ahistory management, a touch location, a touch detection time, or touchinformation (e.g., a touch pressure, a touch direction, a touch durationtime, or the like).

A detection of a third hovering performed in operation S430 of FIG. 4 issimilar to the detection of the first hovering performed in operationS410 of FIG. 4, and thus a repeated description thereof is omitted.

The controller 110 may request a measurement of EEG of the user from thewearable apparatus 200 in response to a third touch. If the third touchis detected, the controller 110 may generate a control command (e.g., acontrol packet) corresponding to the measurement of the EEG of the user.

The controller 110 may transmit the generated control command to thewearable apparatus 200 through a communicator. The control commandtransmitted to the wearable apparatus 200 through the communicator mayhave a hierarchical structure.

The control packet corresponding to the control command may includethree frames including a MAC header (not shown) corresponding to anaddress and a length of a receiver (e.g., a wearable apparatus), apayload (not shown) corresponding to an EEG measurement request of thewearable apparatus 200, and a cyclical redundancy check (CRC) (notshown) corresponding to a transmission error detection.

The storage unit 175 may store the control command, which is generatedcorresponding to a user EEG measurement request from the wearableapparatus 200, under control of the controller 110.

The controller 210 of the wearable apparatus 200 may receive the controlcommand corresponding to the user EEG measurement request transmittedfrom the portable apparatus 100. The received control command may bestored in the storage unit 275 under control of the controller 210.

The controller 210 of the wearable apparatus 200 may start measuring EEGof the user in response to the received control command. The controller210 of the wearable apparatus 200 may measure raw data corresponding tothe EEG of the user by using the measurement electrode 271 and thereference electrode 272. The raw data corresponding to the measured EEGof the user may be stored in the storage unit 275 under control of thecontroller 210.

The controller 210 of the wearable apparatus 200 may convert themeasured draw data into digital data. The converted digital data may bestored in the storage unit 275 under control of the controller 210.

The raw data may be stored as EEG information of the user, including anID for a history management, a wearable apparatus name, the number ofsensors, the number of electrodes, a measurement date, a measurementtime, or raw data (or converted digital data), in the storage unit 275.

The controller 210 of the wearable apparatus 200 may transmit at leastone selected from the raw data, the digital data, and EEG information ofthe user stored in the storage unit 275 to the portable apparatus 100through the communicator 230. The controller 210 of the wearableapparatus 200 may also transmit the EEG information of the user storedin the storage unit 275 to the portable apparatus 100 through thecommunicator 230.

In various embodiments of the present disclosure, the EEG information ofthe user may include the raw data or the converted digital data.

The controller 210 of the wearable apparatus 200 may periodically (e.g.,100 msec that is changeable by setting) transmit the stored raw dataand/or digital data to the portable apparatus 100 through thecommunicator 230.

The controller 110 of the portable apparatus 100 may receive the EEGinformation of the user from the wearable apparatus 200 through acommunicator. The storage unit 175 may store the received EEGinformation of the user under control of the controller 110.

In operation S440 of FIG. 4, a content is displayed on a screen of theportable apparatus.

Referring to FIG. 5C, the controller 110 of the portable apparatus 100may display a content (e.g., a webpage 700) on the screen. That is, theuser may touch a shortcut icon 193 d of FIG. 5A corresponding to a webbrowser.

The controller 110 may detect a touch (not shown) by using the touchscreen 190 and the touch screen controller 195. The controller 110 maycalculate a touch location (e.g., X and Y coordinates (not shown))corresponding to the touch by using an electrical signal received fromthe touch screen controller 195.

A detection of a touch on a shortcut icon corresponding to a web browserperformed in operation S440 of FIG. 4 is similar to the detection of thefirst touch performed in operation S410 of FIG. 4, and thus a repeateddescription thereof is omitted.

Referring to FIG. 5C, the controller 110 may execute a web browser inresponse to the touch. The controller 110 may display the webpage 700through the web browser executed in response to the touch. The user mayperform web surfing by using the displayed web browser.

It will be easily understood by those skilled in the art that a webbrowser displaying a content (e.g., a webpage) is one of variousembodiments of the present disclosure, and various types of applicationsdisplaying (or playing) various types of contents including a videoplayer playing an audio file or a video file, a music player playing amusic file, a photo gallery displaying a photo file, a word processorwriting a document, etc. may be executed by an input of a user.

In operation S450 of FIG. 4, EEG information is received from thewearable apparatus.

Referring to FIG. 5D, the controller 110 of the portable apparatus 100may receive EEG information of the user from the wearable apparatus 200through a communicator. The received EEG information of the user mayinclude raw data or converted digital data.

The EEG information of the user received from the wearable apparatus 200may vary in response to the number of the measurement electrodes 271 ofthe wearable apparatus 200. If the number of measurement electrodes 271of the wearable apparatus 200 is 2 (e.g., refer to FIG. 3A), thereceived EEG information of the user may correspond to 2 channels. Ifthe number of measurement electrodes 271 of the wearable apparatus 200is 3 (e.g., refer to FIG. 3B), the received EEG information of the usermay correspond to 2 channels. In (a) of FIG. 5D, the EEG information ofthe user received from the wearable apparatus 200 may correspond to 4channels.

The storage unit 175 may store the received EEG information of the userunder control of the controller 110.

The controller 110 may first calculate a visual fatigue of the user whois in a rest status, by using the wearable apparatus 200.

A generation equation for calculating the visual fatigue of the user maybe expressed as in Equation 1 below. The controller 110 may perform anoperation by using Equation 1 below to calculate the visual fatigue ofthe user.

$\begin{matrix}{{{Visual}\mspace{14mu}{Fatigue}} = \frac{( {\theta + \alpha} )}{\beta}} & {{Equation}\mspace{14mu} 1}\end{matrix}$

In Equation 1 above, θ denotes a size of a theta wave, a denotes a sizeof an alpha wave, and β denotes a size of a beta wave. The visualfatigue calculated by using Equation 1 above may have a range between 01and 3.4. The visual fatigue in the rest status may be lower than orequal to 2.2. Also, if the visual fatigue is higher than or equal to2.6, the controller 110 may determine an increase in the visual fatigue.

The controller 110 may determine a visual fatigue of the user in therest status by using received user EEG and Equation 1. The controller110 may also determine the visual fatigue of the user in the rest statusby using user EEG received in a pre-stored user visual fatigue range(e.g., calculated by using Equation 1). For example, the user visualfatigue in the rest status may be lower than or equal to about 2.2. Athreshold value corresponding to an increase in a visual fatigue may be2.6. The threshold value may be changed by a body condition and/or asurrounding environment of the user.

The calculated user visual fatigue in the rest status may be stored inthe storage unit 175 under control of the controller 110.

It will be easily understood by those skilled in the art that thecalculated user visual fatigue in the rest status may be changed by thebody condition and/or the surrounding environment of the user.

The controller 110 may determine the increase in the visual fatigue ofthe user by using a pre-stored user visual fatigue in a rest status.

In operation S460 of FIG. 4, the received EEG information of the user isanalyzed.

Referring to FIG. 5D, the controller 110 may calculate the visualfatigue of the user by using the received EEG information of the userand a visual fatigue application. The controller 110 may analyze userEEG according to frequency bands by using the visual fatigueapplication. The controller 110 may perform fast fourier transform (FFT)on the received EEG information of the user to analyze the received EEGinformation of the user. For example, if an amplitude change is large ona horizontal axis (e.g., time) of (a) of FIG. 5D, a frequency componentmay be located in a high area of a vertical axis (e.g., power) of (b) ofFIG. 5D.

The controller 110 may calculate the visual fatigue by using adifference in a latency of a peak value of two EEGs that arerespectively measured by a measurement electrode 271 located in anoccipital lobe accepting a visual stimulus from the received EEGinformation of the user and a measurement electrode 271 located in afrontal lobe processing the visual stimulus. The latency may refer to atime when waves of EEG greatly fluctuate after receiving a stimulus withan increase in the visual fatigue of the user. The controller 110 maygenerate an average frequency component of EEG for a total period forwhich user EEG is collected through FFT.

The calculated visual fatigue may be stored in the storage unit 175under control of the controller 110.

In operation S470 of FIG. 4, it is determined whether the visual fatigueincreases.

As in (b1) and (b2) of FIG. 5D, the controller 110 may determine anincrease in the visual fatigue. If the visual fatigue of the userincreases, power of θ and a wave bands may increase. If power increasesin a band between 6 Hz and 7 Hz, which is a θ wave, through an analysisof user EEG, the controller 110 may determine an occurrence of a visualfatigue of the user. Also, if power increases in a band between 8 Hz and11 Hz, which is an a wave through a user EEG analysis, the controller110 may determine an occurrence in the visual fatigue of the user.

The controller 110 may compare a pre-stored visual fatigue in a reststatus and a visual fatigue calculated from the received EEG informationof the user. If the visual fatigue calculated by using the received EEGinformation of the user and Equation 1 is higher than or equal to 2.6,the controller 110 may determine the increase in the visual fatigue ofthe user.

The controller 110 may determine the increase in the visual fatigue ofthe user by using one or both of a power increase of the 0 wave band anda power increase of the α wave band.

If it is determined in operation S470 of FIG. 4 that the visual fatiguedoes not occur, the method of changing the content screen of theportable apparatus ends.

On the other hand, if it is determined in operation S470 that the visualfatigue does occur, a displayed content is changed in operation S480.

Referring to FIGS. 5E to 11B, the controller 110 may change a content(e.g., a webpage) displayed on a web browser.

Referring to FIG. 5E, the controller 110 may display a pop-up window 701corresponding to an occurrence of a visual fatigue of the user. Thecontroller 110 may display the pop-up window 701 to distinguish thepop-up window 701 from the webpage 700. The controller 110 may displaythe pop-up window 701 having a transparency (e.g., a value between 0%and 100%). The transparency may be changed through an environmentsetting.

The controller 110 may display the pop-up window 701 so as to overlapthe pop-up window 701 with the webpage 700. The controller 110 maydisplay the pop-up window 701 for a determined time (e.g., 1 sec that ischangeable by an environment setting).

A size of the displayed pop-up window 701 is smaller than a size of thewebpage 700. For example, the size of the pop-up window 701 may includea range between 10% and 85% based on the size of the webpage 700. Also,the size of the pop-up window 701 may include a range between 30% and55% based on the size of the webpage 700.

If an icon 701 a is selected, the controller 100 may enable thedisplayed pop-up window 701 to disappear.

Also, the controller 110 may change the content 700 displayed on the webbrowser into another content 710 without displaying the pop-up window701. The controller 110 may quickly (e.g., in response to a display timeof the pop-up window 701) change the content 700 displayed on the webbrowser into the other content 710 without displaying the pop-up window701.

If a preset time elapses or the icon 701 a is selected, the controller110 may change the displayed webpage 700. If the preset time elapses orthe icon 701 a is selected, the controller 110 may change the displayedwebpage 700 by using an environment setting (e.g., a visual fatigueenvironment setting as shown in FIGS. 12A to 12C). If the preset timeelapses or the icon 701 a is selected, the controller 110 may change thedisplayed webpage 700 by using an environment setting (e.g., a visualfatigue environment setting as shown in FIGS. 12A to 12C) and portableapparatus information (e.g., a resolution, a screen size, or the like).

Referring to FIG. 5F, the controller 110 may change the webpage 700 intothe other webpage 710 having a changed font size in response to theincrease in the visual fatigue of the user. A font size of the changedwebpage 710 may be larger than a font size of the original webpage 700.For example, if the font size of the original webpage 700 is 20 pixels,the font size of the changed webpage 710 may be 40 pixels (e.g., may betwo times larger than the font size of the original webpage 700). A fontsize may include a scale-independent pixel (sp) or a device-independentpixel (dp).

It will be easily understood by those skilled in the art that atwo-times increase in the font size of the changed webpage 710 is oneembodiment, and the font size of the changed webpage 710 may be changedinto other various types of font sizes.

The font size may be changed in response to an application executed inthe portable apparatus 100. If the visual fatigue of the user occurs,the controller 110 may differently change the font size in response tothe application executed in the portable apparatus 100. For example, ifthe visual fatigue of the user occurs, the controller 110 maydifferently change a font size of a webpage displayed on a web browserand a font size of a text displayed on a processor.

As shown in FIG. 5F, the visual fatigue of the user may decrease by thewebpage 710 having a changed font size.

If the content is changed into another content, the controller 110 maycontinuously calculate the visual fatigue by using the received EEGinformation of the user.

If the calculated visual fatigue of the user decreases, the controller110 may restore the displayed other content 710 to the content 700 thatis unchanged.

It will be easily understood by those skilled in the art that differentfont sizes displayed on a web browser and a word processor are oneembodiment and may be changed in response to various types ofapplications. Also, it will be easily understood by those skilled in theart that the font size may be changed in response to the increase in thevisual fatigue of the user so as to correspond to a screen size and/or aresolution of the portable apparatus 100.

Referring to FIGS. 6A to 6D, the controller 110 may change the webpage700 into a webpage 720 having a changed layout in response to anincrease in a visual fatigue of the user. The changed layout of thewebpage 720 may be a layout where the original webpage 700 is dividedinto three areas (e.g., as shown in FIGS. 6B, 6C, and 6D) or four areas(e.g., as shown in FIG. 6A). The changed layout of the webpage 720 maybe divided into two areas (not shown) or five or more areas. A text, animage, or a moving image (e.g., a flash or the like) included in thewebpage 700 may be displayed in the changed layout of the webpage 720.

As shown in FIG. 6A, the changed layout of the webpage 720 may includeone horizontal area 720 a and three vertical areas 720 b, 720 c, and 720d. Widths of spaces between the areas 720 a through 720 d may be smallerthan one of a height and a width of each of the areas 720 a through 720d. Also, areas of the three vertical areas 720 b through 720 d may bedifferent from one another.

As shown in FIG. 6B, the changed layout of a webpage 721 may includethree vertical areas 721 a, 721 b, and 721 c. Widths of spaces betweenthe areas 721 a through 721 c may be smaller than one of widths of thethree areas 721 a through 721 c. Areas of the three vertical areas 721 athrough 721 c may be different from one another. Areas of two of thethree vertical areas 721 a through 721 c may be the same.

As shown in FIG. 6C, a changed layout of a webpage 722 may include onehorizontal area 722 a and two vertical areas 722 b and 722 c. Widths ofspaces between the areas 722 a through 722 c may be smaller than one ofa height and a width of each of the areas 722 a through 722 c. Areas ofthe two vertical areas 722 b and 722 c may be different from each other.Also, areas of two of the three areas 722 a through 722 c may be thesame.

As shown in FIG. 6D, a changed layout of a webpage 723 may include threehorizontal areas 723 a, 723 b, and 723 c. Widths of spaces between thethree horizontal areas 723 a through 723 c may be smaller than one ofwidths of the three horizontal areas 723 a through 723 c. Areas of thethree horizontal areas 723 a through 723 c may be different from oneanother. Areas of two of the three horizontal areas 723 a through 723 cmay be the same.

A visual fatigue of a user may decrease by a change in an ocularmovement direction and/or a changing of a focus direction caused by thechanged layout of the webpage 720 as shown in FIGS. 6A to 6D.

If a content is changed into another content, the controller 110 maycontinuously calculate the visual fatigue by using the received EEGinformation of the user.

If the calculated visual fatigue of the user decreases, the controller110 may restore the displayed other contents 720 through 723 to thecontent 700.

It will be easily understood by those skilled in the art that layouts asshown in FIGS. 6A to 6D are embodiments, and thus layouts, areasincluded in the layouts, and locations of the areas included in thelayouts may be changed in response to various types of applications.

Referring to FIGS. 7A and 7B, the controller 110 may change (or add) awebpage 700 to a webpage including a color screen 730 or 731 in responseto an increase in a visual fatigue of a user. The color screen 730 or731 may include a green area or a greenish area (e.g., a yellowish greenarea, a dark green area, or the like) that does not give a greatstimulus to eyes of the user. The color screen 730 or 731 may bealternatively be considered a “color filter”.

The controller 110 may display the color screen 730 or 731 in an areaset on the webpage 700. The controller 110 may add the color screen 730or 731 so as to overlap the color screen 730 or 731 with the webpage700. The color screen 730 or 731 may have a transparency (e.g., a valuebetween 0% and 100% that is changeable by an environment setting).

An area of the color screen 730 may be between 30% and 50% of an area ofthe webpage 700. An area of the color screen 731 may be the same as thearea of the webpage 700. The area of the color screen 731 may be an areaexcept at least one selected from an address display bar 700 a, a tapicon 700 b, and a search icon 700 c on the webpage 700. The area of thecolor screen 731 may also include a status bar 192 and the webpage 700.

The displayed color screen 730 may include a polygonal, circular, orfreestyle shape. The color screen 730 may be located in one of an upperarea, a central area, and a lower area based on a central area of thewebpage 700.

Color screen information (e.g., an ID for a history management, a colorof a color screen, a size of the color screen, a storage location of thecolor screen, a location of the color screen in a webpage, or the like)corresponding to the color screen 730 or 731 may be stored in thestorage unit 175 under control of the controller 110.

The controller 110 may change a background color of the webpage 700 intoone of a green color and a greenish color so as to enable the backgroundcolor of the webpage 700 to correspond to the color screen 730 or 731.

Referring to FIG. 7C, the controller 110 may change the webpage 700 intoa webpage 700 including a visual fatigue relax video 732 in response tothe increase in the visual fatigue of the user.

The visual fatigue relax video 732 may be a visual fatigue relax video(e.g., a forest landscape or the like) of a green color or a greenishcolor (e.g., a yellowish green color, a dark green color or the like)that does not give a great stimulus to the eyes of the user.

The controller 110 may display the visual fatigue relax video 732 so asto overlap with the webpage 700. The visual fatigue relax video 732 mayhave a transparency (e.g., a value between 0% and 100% that ischangeable by an environment setting).

An area of the visual fatigue relax video 732 may be between 25% and 85%of an area of the webpage 700. The area of the visual fatigue relaxvideo 732 may also be the same as the area of the webpage 700. Thevisual fatigue relax video 732 may be located in one of an upper area, acentral area, and a lower area based on a central area of the webpage700.

Visual fatigue relax video information (e.g., an ID for a historymanagement, a visual fatigue relax video name, a visual fatigue relaxvideo play time, a visual fatigue relax video storage location, alocation of a visual fatigue relax video in a webpage, or the like)corresponding to the visual fatigue relax video 732 may be stored in thestorage unit 175 under control of the controller 110.

The visual fatigue relax video 732 may include a text to speech (TTS)service. The controller 110 may convert a text included in the webpage700 into a voice and output the voice in response to the increase in thevisual fatigue of the user. If the text is converted into the voice andthen output, the controller 110 may display a speaker icon 732 a.

If the content is changed into another content, the controller 110 maycontinuously calculate the visual fatigue by using received EEGinformation of the user.

If the calculated visual fatigue of the user decreases, the controller110 may restore displayed other contents 730 through 732 to the content700 that is unchanged.

Referring to FIGS. 8A and 8B, a first e-book screen 740 may be displayedon a screen of the portable apparatus 100. If a current page 741 goes tothe left by the user on the first e-book screen 740, the controller 110may display a visual fatigue relax color screen 742 a on a next page 742of the first e-book screen 740 in response to an increase in a visualfatigue of a user.

If the current page 741 is modified into a convex shape and then goes tothe left through a user input, the controller 110 may display the visualfatigue relax color screen 742 a so as to overlap the visual fatiguerelax color screen 742 a with the next page 742. The visual fatiguerelax color screen 742 a may have a transparency (e.g., a value between0% and 100% that is changeable by an environment setting).

If the current page 741 is modified into the convex shape and then goesto the left in response to a location of the user input (e.g., a touchor a touch gesture) (e.g., as shown in FIGS. 8A and 8B), the controller110 may differently display the visual fatigue relax color screen 742 adisplayed on the next page 742.

If the current page 741 is upwards modified into a convex shape througha user input and then gradually goes to the left, the controller 110 maydisplay a larger part of the visual fatigue relax color screen 742 a onthe next page 742.

The controller 110 may change a background color of the next page 742into one of a green color and a greenish color in response to the visualfatigue relax color screen 742 a.

If the content is changed into another content, the controller 110 maycontinuously calculate the visual fatigue by using received EEGinformation of the user.

If the calculated visual fatigue of the user decreases, the controller110 may restore the content 742 to the content 741.

Referring to FIGS. 9A to 9C, a second e-book screen 750 may be displayedon a screen of the portable apparatus 100. If a current page 751 goes tothe left on the second e-book screen 750 by a user, the controller 110may display a visual fatigue relax color screen 753 on a back surface751 a of the current page 751 on the second e-book screen 750 inresponse to an increase in a visual fatigue of the user. A next page 752does not overlap with the visual fatigue relax color screen 753.

If the current page 751 is folded and then goes to the left through auser input, the controller 110 may display the visual fatigue relaxcolor screen 753 so as to overlap the visual fatigue relax color screen753 with the back surface 751 a of the current page 751. The visualfatigue relax color screen 753 may have a transparency (e.g., a valuebetween 0% and 100% that is changeable by an environment setting).

If the current page 751 is folded and then goes to the left (as shown inFIGS. 9A to 9C) in response to a location of the user input (e.g., atouch or a touch gesture), the controller 110 may differently displaythe back surface 751 a of the current page 751.

If the current page 751 is folded and then gradually goes to the leftthrough a user input, the controller 110 may display a larger part ofthe visual fatigue relax color screen 753 on the back surface 751 a ofthe current page 751.

If a content is changed into another content, the controller 110 maycontinuously calculate the visual fatigue by using received EEGinformation of the user.

If the calculated visual fatigue of the user decreases, the controller110 may restore the content 753 to the content 751.

Referring to FIG. 10A, a third e-book screen 760 may be displayed on ascreen of the portable apparatus 100. If a current page 761 goes to theleft on the third e-book screen 760 by a user, the controller 110 maydisplay an ocular movement guide 763 on a back surface 761 a of thecurrent page 761 on the third e-book screen 760 in response to anincrease in a visual fatigue of the user. For example, the ocularmovement guide 763 may include “Please, blink eyes.”, “Please, move eyesup and down.”, “Please, move eyes from side to side.”, or “Please, moveeyes up, down, and from side to side.”

The ocular movement guide 763 displayed on the back surface 761 a of thecurrent page 761 may be realized as one of a text, an image, and amoving image. For example, if the ocular movement guide 763 is the text,a font size of the displayed content may correspond to an area of theback surface 761 a. For example, as shown in FIG. 10A, if the area ofthe back surface 761 a of the current 761 is 20% of the current page761, the font size of the text may be 20 pixels in the ocular movementguide 763. If the current page 761 goes to the left more, and thus thearea of the back surface 761 a is 40% of the current page 761, the fontsize of the text may be 35 pixels in the ocular movement guide 763 inresponse to the increased area of the back surface 761 a. As the area ofthe back surface 761 a increases, the font size of the text may increasein the ocular movement guide 763.

The ocular movement guide 763 displayed on the back surface 761 a of thecurrent page 761 does not overlap with a next page 762.

If the current page 761 is folded and then goes to the left through auser input, the controller 110 may display the ocular movement guide 763on the back surface 761 a of the current page 761. Also, if the currentpage 761 is folded and then goes to the left through the user input, thecontroller 110 may display the ocular movement guide 763 so as tooverlap the ocular movement guide 763 with the back surface 761 a of thecurrent page 761. If the ocular movement guide 763 overlaps with theback surface 761 a of the current page 761, the ocular movement guide763 may have a transparency (e.g., a value between 0% and 100% that ischangeable by an environment setting).

As shown in FIG. 10A, if the third e-book screen 760 is displayed on thescreen of the portable apparatus 100, the controller 110 may execute afirst camera 151.

The controller 110 may detect whether an ocular movement of the usercorresponding to the ocular movement guide 763 is performed, by usingthe first camera 151. The controller 110 may detect whether the ocularmovement of the user is performed, by using the first camera 151 and aface recognition. If the user blinks their eyes corresponding to theocular movement guide 763, the controller 110 may detect nictations ofthe user by using the first camera 151 and the face recognition. Forexample, if the displayed ocular movement guide 763 is “Please, blinkeyes 10 times.”, the controller 110 may count the number of nictationsof the user by using the first camera 151 and the face recognition. Ifthe number of nictations is lower than 10 times, the controller 110 maynot turn the current page 761 but may keep the current page 761.

The ocular movement guide 763 that is displayed in response to anincreased degree of a visual fatigue may be changed (e.g., the number ofnictations may increase with an increase in the number of nictations).

In various embodiments of the present disclosure, an ocular movementguide may be an ocular movement animation. Also, the ocular movementanimation may include first through third exercise animations 764 ofFIG. 10B, 771 of FIG. 11A, and 775 of FIG. 11B. An animation may referto a moving image.

If a content is changed into another content, the controller 110 maycontinuously calculate a visual fatigue by using received EEGinformation of the user.

If the calculated visual fatigue of the user decreases, the controller110 may restore the displayed content 761 b to the content 760.

Referring to FIG. 10B, the third e-book screen 760 may be displayed onthe screen of the portable apparatus 100. If the current page 761 goesto the left on the third e-book screen 760 by the user, the controller110 may display the first ocular movement animation 764 on the backsurface 761 a of the current page 761 on the third e-book screen 760 inresponse to an increase in the visual fatigue of the user.

The first ocular movement animation 764 may be an animationcorresponding to eye-tracking for tracking eyes of the user. Forexample, the controller 110 may detect user eyes located in a firstpoint 764 a that is an initial location in the first ocular movementanimation 764 by using the first camera 151.

If the eyes of the user are detected from the first point 764 a, thecontroller 110 may display a trajectory 764 t inducing the eyes of theuser downwards. Also, the controller 110 may further display a directionsymbol 765 that is adjacent to the trajectory 764 t and induces the eyesof the user downwards. The controller 110 may display the directionsymbol 765 on the current page 761 or the next page 762.

The trajectory 764 t may include intermediate points 764 b and 764 cfrom the first point 764 a and a fourth point 764 d that is a finallocation. The trajectory 764 t includes a plurality of points, and fourpoints 764 a through 764 d are only an example.

The controller 110 may detect the eyes of the user following thetrajectory 764 t by using the first camera 151 and eye-tracking. Thecontroller 110 may detect the eyes of the user located in the fourthpoint 764 d that is the final location in the first ocular movementanimation 764, by using the first camera 151. If the eyes of the userare detected from the fourth point 764 d, the controller 110 may repeatthe first ocular movement animation 764.

If the number of times the eyes of the user follow the trajectory islower than the number of times the first ocular movement animation 764is repeated or the eyes of the user starting from the first point 764 aare not detected from the fourth point 764 d, the controller 110 may notturn the current page 761 but may keep the current page 761.

The first ocular movement animation 764 that is displayed in response toan increased degree of a visual fatigue may be changed (e.g., thetrajectory 764 t may be more curved with an increase in the visualfatigue).

If the content is changed into another content, the controller 110 maycontinuously calculate the visual fatigue by using received EEGinformation of the user.

If the calculated visual fatigue of the user decreases, the controller110 may restore the displayed content 764 to the content 760.

Referring to FIG. 11A, the controller 110 may change the webpage 700into a webpage 770 including a color screen 770 a in response to anincrease in a visual fatigue of a user. The color screen 770 a mayinclude a green or greenish area (e.g., a yellowish green area, a darkgreen area, or the like) that does not give a great stimulus to eyes ofthe user.

The controller 110 may display a second ocular movement animation 771 soas to overlap the second ocular movement animation 771 with the colorscreen 770 a of the webpage 770. The second ocular movement animation771 may have a transparency (e.g., a value between 0% and 100% that ischangeable by an environment setting).

The second ocular movement animation 771 may be an animationcorresponding to an iris recognition for recognizing irises of the user.For example, the controller 110 may detect irises of the user located ina first location 771 a, where eyes of the user are opened (e.g., theirises are recognized), from the second ocular movement animation 771 byusing the first camera 151.

If the irises of the user are detected from the first location 771 a,the controller 110 may display a direction symbol 772 that induces theeyes of the user downwards.

The controller 110 may detect nictations of the user corresponding tothe direction symbol 772 by using the first camera 151 and the irisrecognition. The controller 110 may detect eyelid closures of the userfrom a second location 771 b that is a final location, in the secondocular movement animation 771 by using the first camera 151. If theeyelid closures are detected from the second location 771 b, thecontroller 110 may repeat the second ocular movement animation 771.

The number of times the second ocular movement animation 771 beingrepeated may be displayed in a counter 773. The counter 773 may displaythe total number of repeated times and the current number of repeatedtimes.

If the nictations of the user are lower than the total number of timesthe second ocular movement animation 764 is repeated, the controller 110may not change the webpage 770 but may keep the webpage 770.

The second ocular movement animation 771 that is displayed in responseto the increase in the visual fatigue may be changed (e.g., the numberof repeated times the second ocular movement animation 771 beingrepeated may increase with the increase in the visual fatigue).

If a content is changed into another content, the controller 110 maycontinuously calculate the visual fatigue by using received EEGinformation of the user.

If the calculated visual fatigue of the user decreases, the controller110 may restore the displayed contents 771, 772, and 773 to the content770.

Referring to FIG. 11B, the controller 110 may change the webpage 700into a webpage 770 including a color screen 770 a in response to anincrease in a visual fatigue of the user. The color screen 770 a mayinclude a green or greenish area (e.g., a yellowish green area, a darkgreen area, or the like) that does not give a great stimulus to the eyesof the user.

The controller 110 may display a third ocular movement animation 775 soas to overlap the third ocular movement animation 775 with the colorscreen 770 a of the webpage 770. The third ocular movement animation 775may have a transparency (e.g., a value between 0% and 100% that ischangeable by an environment setting).

The third ocular movement animation 771 may be an animationcorresponding to eye-tracking for tracking the eyes of the user. Forexample, the controller 110 may detect irises of the user correspondingto status 1, where both eyes of the user are moved to the left, from thethird ocular movement animation 775.

If the irises of the user are detected in the status 1 where the botheyes of the user are moved to the left, the controller 110 may display adirection symbol 775 a that induces the eyes of the user to the right.

The controller 110 may detect ocular movements of the user correspondingto the direction symbol 775 a by using the first camera 151 and the irisrecognition. The controller 110 may detect the irises of the user in astatus 8, in which both eyes of the user are moved to the left and whichis a final location, from the third ocular movement animation 771 byusing the first camera 151. If the irises of the user are detected fromthe final location 8, the controller 110 may repeat the third ocularmovement animation 775.

The number of times the third ocular movement animation 771 beingrepeated may be displayed in a counter 776. The counter 776 may displaythe total number of repeated times and the current number of repeatedtimes.

If the total number of repeated times or the current number of repeatedtimes is lower than the total number of the third ocular movementanimation 775 being repeated, the controller 110 may not change thewebpage 770 but may keep the webpage 770.

The third ocular movement animation 771 that is displayed in response toan increased degree of the visual fatigue may be changed (e.g., thenumber of repeated times the third ocular movement animation 771 beingrepeated may increase with the increase in the visual fatigue).

If the content is changed into another content, the controller 110 maycontinuously calculate the visual fatigue by using received EEGinformation of the user.

If the calculated visual fatigue of the user decreases, the controller110 may restore the other contents 775 and 776 to the content 770.

If the displayed content is changed in operation S480 of FIG. 4, themethod of changing the content screen of the portable apparatus ends.

In various embodiments of the present disclosure, the portable apparatus100 may infer a visual fatigue without bio-information of the user(e.g., EEG information).

The controller 110 of the portable apparatus 100 may store a visualfatigue DB in the storage unit 175, wherein the visual fatigue DBcorresponds to a visual fatigue calculated based on the bio-informationof the user (e.g., EEG information) received from the wearable apparatus200. The controller 110 of the portable apparatus 100 may infer a visualfatigue occurrence start time by using the stored visual fatigue DBwithout the bio-information of the user received from the wearableapparatus 200.

Visual fatigue items included in the visual fatigue DB may include an IDfor a history management, an application type (e.g., a web browser, avideo player, a game, or the like) executed in the portable apparatus100, a content type (e.g., a webpage, a video, a game, or the like), anapplication execution start time, a visual fatigue occurrence time, avisual fatigue duration time, a visual fatigue occurrence cycle, userfatigue bio-information (e.g. a heart rate, a temperature, or the likeif a visual fatigue occurs), another content change information (e.g.,another content type, another content change start time, or the like),etc.

The controller 110 may manage a visual fatigue history of the user byusing the accumulated visual fatigue DB. The controller 110 may learnthe visual fatigue of the user by using the stored visual fatigue DB andmachine learning. The controller 110 may learn the visual fatigue of theuser by using the stored visual fatigue DB, a statistical analysis, abig data analysis, or machine learning. The statistical analysis mayrefer to a regression analysis, a time-series analysis, or an analysisusing an execution of a regular check or the like in statisticalsoftware. Also, a computing apparatus may extract (or search for),analyze, and determine a pattern of accumulated big data, and infer aresult through machine learning. The controller 110 may infer a visualfatigue through an accumulation of visual fatigue learning. Thecontroller 110 may infer a visual fatigue of the user by using a storedvisual fatigue DB, a statistical analysis, a big data analysis, ormachine learning.

For example, if the user executes a web browser, the controller 110 mayinfer a user visual fatigue occurrence time, a visual fatigue durationtime, a visual fatigue occurrence cycle, etc. corresponding to theexecution of the web browser by using a visual fatigue DB withoutbio-information of the user (e.g., EEG information) received from thewearable apparatus 200.

If the visual fatigue of the user increases, the controller 110 mayprovide the user with another content corresponding to a decrease in thevisual fatigue as shown in FIGS. 5A and 11B.

The providing of the other content corresponding to the increase in thevisual fatigue without receiving the bio-information of the user (e.g.,EEG information) from the wearable apparatus 200 is similar to providingof another content corresponding to the decrease in the visual fatigueas shown in FIGS. 5A and 11B, and thus a repeated description thereof isomitted.

According to another embodiment of the present disclosure, the server300 that receives bio-information of the user (e.g., EEG information)transmitted from the wearable apparatus 200 may calculate a visualfatigue.

The wearable apparatus 200 may transmit detected bio-information of theuser (e.g., EEG information) to the server 300. The portable apparatus100 may transmit application information (e.g., an application type, acontent type, an application execution start time, or the like)corresponding to an executed application to the server 300.

A controller (not shown) of the server 300 may calculate the visualfatigue based on the bio-information of the user (e.g., EEG information)received from the wearable apparatus 200 and the application informationreceived from the portable apparatus 100. The controller may store avisual fatigue DB corresponding to the calculated visual fatigue in astorage unit (not shown) of the server 300. Visual fatigue itemsincluded in the visual fatigue DB may include an ID for a historymanagement, an application type (e.g., a webpage, a video, a game, orthe like) executed in the portable apparatus 100, a content type (e.g.,a webpage, a video, a game, or the like), an application execution starttime, a visual fatigue occurrence time, a visual fatigue duration time,a visual fatigue occurrence cycle, user fatigue bio-information (e.g., aheart rate, a temperature, of the like if a visual fatigue occurs),another content change information (e.g., another content type, anothercontent change start time, or the like), etc.

The controller of the server 300 may manage a visual fatigue history ofthe user by using an accumulated visual fatigue DB. The controller ofthe server 300 may learn the visual fatigue of the user by using thestored visual fatigue DB and machine learning. The controller 110 maylearn the visual fatigue of the user by using the stored visual fatigueDB, a statistical analysis, a big data analysis, or machine learning.The statistical analysis may refer to a regression analysis, atime-series analysis, or an analysis using an execution of a regularcheck or the like in statistical software. A computing apparatus mayextract (or search for), analyze, and determine a pattern of accumulatedbig data, and infer a result through machine learning.

The controller (not shown) of the server 300 may infer a visual fatiguethrough an accumulation of visual fatigue learning. The controller ofthe server 300 may inter a visual fatigue of the user by using a storedvisual fatigue DB, a statistical analysis, a big data analysis, ormachine learning.

The controller of the server 300 may transmit visual fatigue informationcorresponding to the calculated visual fatigue to the portable apparatus100 through a communicator (not shown). For example, the visual fatigueinformation may include an application type, a content type, a currentvisual fatigue index, a visual fatigue occurrence time, a visual fatigueduration time, etc.

If the calculated visual fatigue of the user increases (e.g., if thevisual fatigue is higher than or equal to 2.6), the controller of theserver 300 may transmit visual fatigue information corresponding to theincreased visual fatigue of the user to the portable apparatus 100.

If the visual fatigue information corresponding to the increase in thevisual fatigue is received from the server 300, the controller 110 ofthe portable apparatus 100 may provide the user with one of othercontents corresponding to the increase in the visual fatigue as shown inFIGS. 5A and 11B.

The providing of the other contents corresponding to the visual fatigueinformation received from the server 300 is similar to the providing ofother contents corresponding to the increase in the visual fatigue asshown in FIGS. 5A and 11B, and thus a repeated description thereof isomitted.

According to another embodiment of the present disclosure, the server300 may infer a visual fatigue without bio-information of the usertransmitted from the wearable apparatus 200.

The server 300 may not be connected to the wearable apparatus 200, whichdetects bio-information of the user (e.g., EEG information), through acommunicator (not shown) but may receive application information (e.g.,an application type, a content type, an application execution starttime, or the like) corresponding to an application executed in theportable apparatus 100.

The controller may store a visual fatigue DB corresponding to apre-calculated visual fatigue in a storage unit (not shown) of theserver 300. Visual fatigue items included in the visual fatigue DB mayinclude an ID for a history management, an application type (e.g., a webbrowser, a video player, a game, or the like) executed in the portableapparatus 100, a content type (e.g., a webpage, a video, a game, or thelike), an application execution start time, a visual fatigue occurrencetime, a visual fatigue duration time, a visual fatigue occurrence cycle,user fatigue bio-information (e.g., a heart rate, a temperature, or thelike if a visual fatigue occurs), etc.

The controller of the server 300 may manage a visual fatigue history ofthe user by using an accumulated visual fatigue DB. The controller ofthe server 300 may learn a visual fatigue of the user by using a storedvisual fatigue DB and machine learning without bio-information of theuser (e.g., EEG information) received from the wearable apparatus 200.The controller may learn the visual fatigue of the user by using astored visual fatigue DB, a statistical analysis, a bid data analysis,or machine learning. The statistical analysis may refer to a regressionanalysis, a time-series analysis, or an analysis using an execution of aregular check or the like in statistical software. A computing apparatusmay extract (or search for), analyze, and determine a pattern of biddata, and inter a result through machine learning.

The controller of the server 300 may infer the visual fatigue through anaccumulation of visual fatigue learning. The controller of the server300 may infer a visual fatigue of the user by using a stored visualfatigue DB, a statistical analysis, a big data analysis, or machinelearning.

The controller of the server 300 may transmit visual fatigue informationcorresponding to the inferred visual fatigue to the portable apparatus100 through a communicator (not shown). For example, the visual fatigueinformation may include an application type, a content type, a currentvisual fatigue index, a visual fatigue occurrence time, a visual fatigueduration time, etc.

If the calculated visual fatigue of the user increases (e.g., if thevisual fatigue is higher than or equal to 2.6), the controller of theserver 300 may transmit the visual fatigue information corresponding tothe increased visual fatigue of the user to the portable apparatus 100through the communicator (not shown).

If the visual fatigue information corresponding to the increase in thevisual fatigue is received from the server 300, the controller 110 ofthe portable apparatus 100 may provide the user with one of othercontents corresponding to the increase in the visual fatigue as shown inFIGS. 5A and 11B.

The providing of the other contents corresponding to the visual fatigueinformation received from the server 300 is similar to the providing ofthe other contents corresponding to the increase in the visual fatigueas shown in FIGS. 5A and 11B, and thus a repeated description thereof isomitted.

Methods according to various embodiments of the present disclosure maybe embodied as a program code form that may be performed through varioustypes of computer units and then may be recorded on a computer readablerecording medium. The computer readable recording medium may include aprogram command, a data file, a data structure, or a combinationthereof. Examples of the computer readable recording medium may includea volatile or nonvolatile storage device such as an ROM or the likeregardless of being detectable or being rewritable, a memory such as anRAM, a memory chip, a device, or an integrated circuit (IC), and astorage medium on which recording may be optically or magneticallyperformed and which may be read in a machine language (e.g., a computer)such as a CD, a DVD, a magnetic disk, a magnetic tape, or the like.

A memory that may be included in a portable apparatus may be an exampleof a storage medium that may store a program including instructionsembodying various embodiments of the present disclosure and may read ina machine language. Program commands recorded on the computer readablerecording medium may be particularly designed and configured for thepresent disclosure or may be well known to and used by computer softwaredevelopers.

While the present disclosure has been shown and described with referenceto various embodiments thereof, it will be understood by those skilledin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the present disclosure asdefined by the appended claims and their equivalents.

What is claimed is:
 1. A method of changing a content screen of aportable apparatus, the method comprising: displaying content;determining whether a value of a visual fatigue is higher than athreshold value using a model trained by machine learning; based on thedetermining that the value of the visual fatigue is higher than thethreshold value, displaying a user interface (UI) indicating an increaseof the visual fatigue and a guide for changing a layout of the contenton the content; and based on a user request being input while the UI isdisplayed, changing the layout of the content.
 2. The method of claim 1,wherein the changing of the layout of the content comprises changing atleast one of a text, an image, or a moving image that is added to thecontent.
 3. The method of claim 1, wherein the changing of the layout ofthe content comprises at least one of a change in a font size of thecontent or an addition of a color screen overlapping the content.
 4. Themethod of claim 1, wherein the method further comprises detecting, by acamera, whether an ocular movement of a user corresponds to an ocularmovement guide.
 5. The method of claim 1, wherein the determining of thevalue of the visual fatigue is performed by a first application, whereinthe content is displayed by a second application, and wherein thechanged layout of the content is differently displayed in response tothe second application displaying the content.
 6. The method of claim 1,wherein the determining comprises determining whether the value of thevisual fatigue is higher than the threshold value by inputtingbio-information of a user to the model trained by machine learning, andwherein the bio-information of the user comprises at least one ofelectroencephalogram (EEG) information, raw data detected from awearable apparatus, or digital data generated by processing the rawdata.
 7. The method of claim 1, wherein the UI is a pop-up window. 8.The method of claim 1, further comprising: providing a user feedbackcorresponding to the increase in the visual fatigue, wherein the userfeedback comprises at least one of a visual feedback, an auditoryfeedback, or a haptic feedback.
 9. The method of claim 1, furthercomprising: selecting a visual fatigue settings menu; and selecting,from the visual fatigue settings menu, at least one of an applicationsetting or a time zone setting, wherein the changed layout of thecontent is displayed according to the selection of the applicationsetting or the time zone setting.
 10. The method of claim 1, wherein themethod further comprises acquiring bio-information of a user while thecontent is displayed.
 11. A portable apparatus comprising: a displayconfigured to display content; and at least one processor configured to:control the display to display content, determine whether a value of avisual fatigue is higher than a threshold value using a model trained bymachine learning, based on determining that the value of the visualfatigue is higher than the threshold value, display a user interface(UI) indicating an increase of the visual fatigue and a guide forchanging a layout of the content on the content, and based on a userrequest being input while the UI is displayed, change the layout of thecontent.
 12. The portable apparatus of claim 11, wherein the at leastone processor is further configured to: determine whether the value ofthe visual fatigue is higher than the threshold value by input ofbio-information of a user to the model trained by machine learning. 13.The portable apparatus of claim 11, further comprising: a camera,wherein the camera is configured to detect whether an ocular movement ofa user corresponds to an ocular movement guide.
 14. The portableapparatus of claim 11, wherein the at least one processor is furtherconfigured to display a color screen in response to an applicationdisplaying the content.
 15. The portable apparatus of claim 11, furthercomprising: a camera, wherein the at least one processor is furtherconfigured to perform at least one of eye-tracking or iris recognitionusing the camera.
 16. The portable apparatus of claim 11, wherein, inresponse to a decrease of the visual fatigue based on the changed layoutof the content, the at least one processor is further configured torestore the changed layout of the content to an original layout of thecontent.
 17. The portable apparatus of claim 11, wherein the display isfurther configured to display a visual fatigue settings menu, whereinthe at least one processor is further configured to receive a selection,from the visual fatigue settings menu, of at least one of an applicationsetting or a time zone setting, and wherein the changed layout of thecontent is displayed according to the selection of the applicationsetting or the time zone setting.
 18. The portable apparatus of claim11, wherein the at least one processor is further configured to: requesta detection of bio-information of a user from a wearable apparatusthrough a communicator, and acquire bio-information of the user from thewearable apparatus while the content is displayed.